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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an on- 
vehicle image processor and an on-vehicle 
navigation device which maintain the safety of a 
traveling vehicle and can also acquire road width 
data by imaging sides from the traveling vehicle 
and performing image processing. 
SOLUTION: An image signal from a CCD 
camera 19a imaging sides of a vehicle is inputted 
to an image processing part 1 8 included in a 
navigation device, and converted into a digital 
image signal by an A/D converter 21 to be frame 
image data having a prescribed frame cycle. Two 
pieces of continuous frame image data are 
respectively stored in 1st and 2nd image memories 
22 and 23. A motion vector detecting part 24 
detects a motion vector in each area of the image 
on the basis of these frame image data and vehicle speed data, and a motion vector 
processing part 25 calculates a distance to a road edge from the vehicle on the basis 
of the motion vector. Further, the width of a road where the vehicle travels can be 
calculated from the distance. Thus, an alarm is issued to a driver when the vehicle 
approaches the road edge, a traffic lane on which the vehicle travels is decided to 
guide the driver to a right lane, the width of the road is stored to be effectively 




utilized later so that the safety and convenience of the vehicle can be improved. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by -the use of -this translation . 

LThis document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The image processing system characterized by to have an image pick-up 
means to picturize the side of a mobile and to output a picture signal, a movement 
vector detection means to detect a movement vector for every field of the picturized 
image based on said picture signal which a mobile is moving, and a distance 
calculation means distinguish said detected spatial rate of change of the magnitude of 
a movement vector, and compute the distance to a road edge based on this rate of 
change. 

[Claim 2] Said distance calculation means is an image processing system according to 
claim 1 characterized by computing the 1 st distance to a left-hand side road edge, and 
the 2nd distance to a right-hand side road edge including 1st image pick-up means by 
which said image pick-up means picturizes the left-hand side side of a mobile, and the 
2nd image pick-up means which picturizes the right-hand side side of a mobile. 
[Claim 3] The image processing system according to claim 2 characterized by having 
further a width-of-road calculation means to compute the width of road of the transit 
road of a mobile, based on said the 1st distance and said 2nd distance. 
[Claim 4] It is an image processing system given in either of claim 1 to claims 3 which 
said picture signal is constituted considering frame image data with a predetermined 
frame period as a unit, and are characterized by said movement vector detection means 
detecting said movement vector based on two continuous frame image data. 
[Claim 5] Said image pick-up means is an image processing system given in either of 
claim 1 to claims 4 characterized by being installed in a before [ a mobile ] side. 
[Claim 6] Said image pick-up means is an image processing system given in either of 
claim 1 to claims 5 characterized by picturizing the side of the approach before slant 
of a mobile. 

[Claim 7] Said image pick-up means is an image processing system given in either of 
claim 1 to claims 6 characterized by picturizing the side of the bottom approach of 
slant of a mobile. 

[Claim 8] It is the image-processing approach of performing an image processing 
based on the picture signal outputted from an image pick-up means to picturize the 
side of a mobile. The movement vector detection process of detecting a movement 
vector for every field of the picturized image based on said picture signal which a 
mobile is moving, The image-processing approach characterized by having the 
distance calculation process which distinguishes the spatial rate of change of the 
magnitude of said detected movement vector, and computes the distance to a road 
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edge based on this rate of change. 

[Claim 9] It is the image-processing approach according to claim 8 which said picture 
signal is outputted, respectively from the 1st image pick-up means which picturizes 
the left-hand side side of a mobile, and the 2nd image pick-up means which picturizes 
the right-hand side side of a mobile, and is characterized by said distance calculation 
process computing the 1st distance to a left-hand side road edge, and the 2nd distance 
to a right-hand side road edge. 

[Claim 10] The image-processing approach according to claim 9 characterized by 
having further the width-of-road calculation process which computes the width of road 
of the transit road of a mobile based on said the 1st distance and said 2nd distance. 
[Claim 11] It is the image-processing approach given in either of claim 8 to claims 10 
which said picture signal is constituted considering frame image data with a 
predetermined frame period as a unit, and are characterized by said movement vector 
detection process detecting said movement vector based on two continuous frame 
image data. 

[Claim 12] The sensor section which is navigation equipment which performs path 
guidance from the current position of a car to the destination based on map data, and 
contains the speed sensor which detects the passing speed of a car, An image pick-up 
means to picturize the side of a car and to output a picture signal, and a movement 
vector detection means to detect a movement vector for every field of the picturized 
image based on said picture signal under car transit, Navigation equipment 
characterized by having a distance calculation means to distinguish the spatial rate of 
change of the magnitude of said detected movement vector, and to compute the 
distance to a road edge based on this rate of change and said passing speed. 
[Claim 13] Navigation equipment according to claim 12 characterized by having 
further a notice means to notify of the car having approached the road edge when said 
computed distance is smaller than the value set up beforehand. 

[Claim 14] Navigation equipment according to claim 12 or 13 characterized by having 
further a width-of-road calculation means to compute the width of road of the transit 
road of a car, based on said computed distance. 

[Claim 15] Navigation equipment according to claim 14 characterized by having 
further a width-of-road data storage means to relate the width-of-road data 
corresponding to said computed width of road with said map data, and to memorize 
them possible [ updating ]. 

[Claim 16] Navigation equipment according to claim 14 or 15 characterized by having 
further a slow lane judging means to judge the slow lane of a car based on the 
calculation result of said distance calculation means and said width-of-road calculation 
means, and a lane notice means to notify of the proper lane should collate said judged 
slow lane with the optimal path to said destination, and it should run based on this 
collating result. 

[Claim 17] the case where, as for said lane notice means, said judged slow lane does 
not agree into said proper lane — this ~ the navigation equipment according to claim 
1 6 characterized by notifying of a proper lane. 

[Claim 18] the case where, as for said lane notice means, said judged slow lane agrees 
into said proper lane — this — the navigation equipment according to claim 16 
characterized by notifying of agreeing into a proper lane. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention belongs to the technical field of the image 
- . processing system and the image-processing approach of asking for the distance and 
the width of road to a road edge based on the picture signal from an image pick-up 
means, and navigation equipment in the car under transit. 
[0002] 

[Description of the Prior Art] The navigation equipment which displays the current 
position which detected the current position of the car as a mobile and was detected 
with the surrounding road map from the former on a display screen, and performs path 
guidance is used widely. In this kind of navigation equipment, it has the mass record 
medium with which map data were memorized, and it is used in order to generate the 
indicative data on a display screen. In addition to data, various data for a display, etc. 
about a road configuration, the width-of-road information which accompanies this is 
included in the map data on a record medium. Therefore, the width-of-road 
information corresponding to the road under transit can be read, and the width of road 
of the road it is running now can be grasped. 
[0003] 

[Problem(s) to be Solved by the Invention] However, with the above-mentioned 
conventional navigation equipment, the width-of-road information included in map 
data does not show the exact width of road, and showed the width of road of the 
outline of the road like 5.5m-8m with it. Therefore, the fine exact width-of-road 
information corresponding to the point of a road was unacquirable. Furthermore, it not 
only gets to know the width of road of a road, but it asks real time for the distance to a 
road, and the needs for using this for insurance transit of a car are strong. 
[0004] Then, by making this invention in view of such a problem, and detecting the 
structures other than the path road surface which adjoins a wall surface, and a slot or a 
path road surface out of an image based on the image picturized from the car under 
transit It aims at offering the navigation equipment which can perform warning and 
guidance for securing insurance transit to a driver according to the result of the image 
processing system for mount which can ask for the distance and the width of road to a 
road edge, and an image processing. 
[0005] 

[Means for Solving the Problem] In order to solve the above-mentioned technical 
problem, an image processing system according to claim 1 An image pick-up means 
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to picturize the side of a mobile and to output a picture signal, and a movement vector 
detection means to detect a movement vector for every field of the picturized image 
based on said picture signal which a mobile is moving, The spatial rate of change of 
the magnitude of said detected movement vector is distinguished, and it is 
characterized by having a distance calculation means to compute the distance to a road 
edge based on this rate of change. 

[0006] According to this invention, with an image processing system, in mobiles, such 
as a car under transit, the image pick-up by the image pick-up means is performed 
towards the side, and a picture signal is outputted. This picture signal is compared at 
the two times, and the movement vector for every field is detected. Although the rate 
of change of a movement vector serves as abbreviation regularity in parts for a 
horizontal level, such as a path road surface in an image, the break point of rate of 
change arises at a road edge. Therefore, it can distinguish for every fields of these, a 
road edge can be distinguished, and the distance to a road edge can be further 
computed based on the magnitude of a movement vector. Therefore, the computed 
- . distance is available for applications, such as security under transit, and exchange of 
navigation, and can raise the safety and convenience of a car. 

[0007] Said distance calculation means is characterized by computing the 1st distance 
to a left-hand side road edge, and the 2nd distance to a right-hand side road edge 
including 1st image pick-up means by which, as for said image pick-up means, an 
image processing system according to claim 2 picturizes the left-hand side side of a 
mobile in an image processing system according to claim 1, and the 2nd image pick- 
up means which picturizes the right-hand side side of a mobile. 

[0008] Towards left-hand side, towards right-hand side, the 2nd image pick-up means 
picturizes, respectively, and, according to this invention, the 1st image pick-up means 
outputs a picture signal by mobiles, such as a car under transit. Like invention 
according to claim 1 , subsequent processing is performed about a right-hand side 
image and a left-hand side image, and can compute the distance to the both-sides road 
edge of a mobile. Therefore, two computed distance is acquired, and grasp of the car 
location in a transit road becomes easy, and can raise the safety and convenience of a 
car further. 

[0009] An image processing system according to claim 3 is characterized by having 
further a width-of-road calculation means to compute the width of road of the transit 
road of a mobile, based on said the 1st distance and said 2nd distance in an image 
processing system according to claim 2. 

[00 1 0] According to this invention, based on two distance computed corresponding to 
the image of the right and left in mobiles, such as a car, the width of road of a transit 
road is computable. For example, when the image pick-up means is installed in the 
flank of car both sides, if two distance is applied and the distance between image pick- 
up means is applied further, the width of road will be obtained. Therefore, using this 
width of road, the insurance under transit is secured or it becomes useful to the 
improvement in functional of the security and navigation of a car, such as acquiring 
width-of-road data. 

[001 1] Said picture signal is constituted considering the frame image data in which an 
image processing system according to claim 4 has a predetermined frame period in an 
image processing system given in either of claim 1 to claims 3 as a unit, and said 
movement vector detection means is characterized by detecting said movement vector 
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based on two continuous frame image data. 

[0012] According to this invention, the object of an image processing is frame image 
data outputted for every frame period, and an above-mentioned image processing is 
performed using two continuous frame image data. Therefore, an image processing is 
always carried out to real time during transit of a car, and the image processing system 
which can respond to the situation of a car promptly can be realized. 
[0013] An image processing system according to claim 5 is characterized by being 
installed in a before [ a mobile ] side by said image pick-up means in an image 
processing system given in either of claim 1 to claims 4. 

[0014] displaying the picture signal from the image pick-up means installed in the 
before [ a mobile ] side on the display screen according to this invention - the above- 
mentioned operation — in addition, a check by looking usually checks easily the 
longitudinal direction by the side of before [ difficult ] a mobile by looking - things 
can be carried out and it becomes much more useful at the security of a car. 
[0015] An image processing system according to claim 6 is characterized by said 
" - image pick-up means picturizing the side of the approach before slant of a mobile in 
an image processing system given in either of claim 1 to claims 5. 
[0016] Since it was made to perform above-mentioned processing based on the picture 
signal from an image pick-up means to picturize the approach before slant of a mobile 
according to this invention, the distance to the road edge in the travelling direction 
front of a car can be computed by preceding it in time, and the run state of a car can be 
grasped quickly. 

[0017] An image processing system according to claim 7 is characterized by said 
image pick-up means picturizing the side of the bottom approach of slant of a mobile 
in an image processing system given in either of claim 1 to claims 6. 
[0018] Since it was made to perform above-mentioned processing based on the picture 
signal from an image pick-up means to picturize the bottom approach of slant of a 
mobile according to this invention, even if it is the case where a road edge is 
approached, into a field angle, it becomes easy to catch a road edge and the safety of a 
transit car can be raised further. 

[0019] The image-processing approach according to claim 8 is the image-processing 
approach of performing an image processing based on the picture signal outputted 
from an image pick-up means to picturize the side of a mobile. The movement vector 
detection process of detecting a movement vector for every field of the picturized 
image based on said picture signal which a mobile is moving, The spatial rate of 
change of the magnitude of said detected movement vector is distinguished, and it is 
characterized by having the distance calculation process which computes the distance 
to a road edge based on this rate of change. 

[0020] According to this invention, the picture signal from the image pick-up means 
installed in mobiles, such as a car under transit, is inputted, according to the same 
operation as invention according to claim 1, a road edge can be distinguished and the 
distance to a road edge can be further computed based on the magnitude of a 
movement vector. Therefore, the computed distance is available for applications, such 
as security under transit, and exchange of navigation, and can raise the safety and 
convenience of a car. 

[0021] The image-processing approach according to claim 9 is outputted for said 
picture signal in the image-processing approach according to claim 8, respectively 
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from the 1st image pick-up means which picturizes the left-hand side side of a mobile, 
and the 2nd image pick-up means which picturizes the right-hand side side of a 
mobile, and said distance calculation process is characterized by computing the 1st 
distance to a left-hand side road edge, and the 2nd distance to a right-hand side road 
edge. 

[0022] According to this invention, the picture signal corresponding to the left-hand 
side side from the 1st image pick-up means installed in mobiles, such as a car under 
transit, and the picture signal corresponding to the right-hand side side from the 2nd 
image pick-up means are inputted, respectively, and the distance to the both-sides road 
edge of a mobile can be computed according to the same operation as invention 
according to claim 2. Therefore, two computed distance is acquired, and grasp of the 
car location in a transit road becomes easy, and can raise the safety and convenience 
of a car further. 

[0023] The image-processing approach according to claim 10 is characterized by 
having further the width-of-road calculation process which computes the width of road 
' - of the transit road of a mobile based on said the 1 st distance and said 2nd distance in 
the image-processing approach according to claim 9. 

[0024] According to this invention, it becomes useful to the improvement in 
functional of the security and navigation of a car, such as the width of road of a transit 
road being computable, and securing the insurance under transit or acquiring width-of- 
road data using this width of road, according to the same operation as invention 
according to claim 3. 

[0025] Said picture signal is constituted considering the frame image data in which the 
image-processing approach according to claim 1 1 has a predetermined frame period in 
the image-processing approach given in either of claim 8 to claims 10 as a unit, and 
said movement vector detection process is characterized by detecting said movement 
vector based on two continuous frame image data. 

[0026] Since an above-mentioned image processing is performed by the same 
operation as invention according to claim 4 using two continuous frame image data 
according to this invention, an image processing is always carried out to real time 
during transit of a car, and the image-processing approach which can respond to the 
situation of a car promptly can be offered. 

[0027] The sensor section which navigation equipment according to claim 12 is 
navigation equipment which performs path guidance from the current position of a car 
to the destination based on map data, and contains the speed sensor which detects the 
passing speed of a car, An image pick-up means to picturize the side of a car and to 
output a picture signal, and a movement vector detection means to detect a movement 
vector for every field of the picturized image based on said picture signal under car 
transit, The spatial rate of change of the magnitude of said detected movement vector 
is distinguished, and it is characterized by having a distance calculation means to 
compute the distance to a road edge based on this rate of change and said passing 
speed. 

[0028] According to this invention, while the passing speed of a car is detected by the 
sensor section of navigation equipment, the image pick-up by the image pick-up 
means is performed towards the car side, and a picture signal is outputted. And the 
image processing by the same operation as invention according to claim 1 is 
performed. Therefore, it can utilize effective in reservation of safety, or other various 
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functions, and the computed distance can raise the safety and convenience of a car. 
[0029] In navigation equipment according to claim 12, navigation equipment 
according to claim 13 is characterized by having further a notice means to notify of 
the car having approached the road edge, when said computed distance is smaller than 
the value set up beforehand. 

[0030] According to this invention, with navigation equipment, since it judges that the 
car approached the road edge too much based on the distance to a road edge and the 
driver was notified of that, the safety and convenience of a car can be raised further. 
[0031] Navigation equipment according to claim 14 is characterized by having further 
a width-of-road calculation means to compute the width of road of the transit road of a 
car in navigation equipment according to claim 12 or 13. 

[0032] When according to this invention the width of road of a transit road can be 
computed, for example, the image pick-up means is installed in the flank of car both 
sides by the car it runs, if two distance is applied and the width of face of a car is 
applied further, the width of road will be obtained. Therefore, it becomes useful to the 
- improvement in functional of the security and navigation of a car to secure the 
insurance under transit, or to acquire width-of-road data, to relate with map data and to 
hold using this width of road, etc. 

[0033] Navigation equipment according to claim 15 is characterized by having further 
a width-of-road data storage means to relate the width-of-road data corresponding to 
said computed width of road with said map data, and to memorize them possible 
[ updating ] in navigation equipment according to claim 14. 
[0034] According to this invention, with the navigation equipment for mount, it 
memorizes possible [ updating of the width-of-road data corresponding to the width of 
road for which the width-of-road data storage means was asked as mentioned above ]. 
Therefore, since it can utilize when the width-of-road data of the road the car ran are 
held and it passes along the road same after that again, the function of navigation 
equipment is supportable. 

[0035] Navigation equipment according to claim 16 is characterized by having further 
a slow lane judging means to judge the slow lane of a car based on the calculation 
result of said distance calculation means and said width-of-road calculation means, 
and a lane notice means to notify of the proper lane should collate said judged slow 
lane with the optimal path to said destination, and it should run based on this collating 
result in navigation equipment according to claim 14 or 15. 

[0036] According to this invention, with navigation equipment, while a car runs the 
road of two or more lanes, the slow lane is judged based on the distance and the width 
of road to a road edge. And the judged lane is collated with an optimal path and 
notifies a driver of the proper lane it should run based on the result. Therefore, since it 
is made to run the lane corresponding to an optimal path, attention of a driver can be 
called, and a comfortable navigation function can be realized. 

[0037] the case where, as for said lane notice means, said judged slow lane does not 
agree into said proper lane in navigation equipment according to claim 16 in 
navigation equipment according to claim 17 — this — it is characterized by notifying of 
a proper lane. 

[0038] According to this invention, the judged lane is collated with an optimal path by 
the same operation as invention according to claim 16, and when it is judged that it is 
not running the lane where a car is proper, a driver is notified of a proper lane. 

http : //www4 . ipdl . ncipi . go . j p/cgi -bin/tran__web_cgi_ej j e 1/12/2005 



Page 6 of 14 



Therefore, avoiding the unnecessary notice at the time of running the proper lane, a 
necessary minimum notice is performed and a comfortable navigation function can be 
realized. 

[0039] the case where, as for said lane notice means, said judged slow lane agrees into 
said proper lane in navigation equipment according to claim 1 6 in navigation 
equipment according to claim 18 — this — it is characterized by notifying of agreeing 
into a proper lane. 

[0040] According to this invention, the judged lane is collated with an optimal path by 
the same operation as invention according to claim 16, and when [ at which it is 
running the lane where a car is proper ] judged, a driver is notified of that. Therefore, a 
driver is made to know running the proper lane and the comfortable navigation 
function to give sense of security to a driver can be realized. 
[0041] 

[Embodiment of the Invention] Hereafter, the gestalt of suitable operation of this 
invention is explained based on a drawing. In the gestalt of the following operations, 
the case where it applies to the navigation equipment in which this invention is carried 
by the car is explained. 

[0042] Drawing 1 is drawing showing the outline configuration of the navigation 
equipment concerning this operation gestalt. The navigation equipment shown in 
drawing 1 is constituted including a control section 11, the map data storage section 
12, the width-of-road data storage section 13, the sensor section 14, the current 
position detecting element 15, a display 16, a loudspeaker 17, the image-processing 
section 18, and CCD cameras 19a and 19b. 

[0043] In the above configuration, a control section 1 1 controls actuation of the whole 
navigation equipment. A control section 1 1 outputs and inputs data while it reads and 
performs the control program which consists of a CPU etc. and is stored in ROM 
which is not illustrated and sends out a control signal to each component of navigation 
equipment. 

[0044] The map data storage section 12 is memory with the big storage capacity which 
stores map data, for example, CD-ROM and DVD-ROM are used. The map data 
stored in the map data storage section 1 2 are constituted including road configuration 
data, name data, background data, etc. 

[0045] The width-of-road data storage section 13 is memory recorded possible 
[ updating of the width-of-road data under car transit obtained in connection with the 
image processing concerning this invention ]. Although simple width-of-road 
information is included also in the map data of the above-mentioned map data storage 
section 12, the width-of-road data memorized by the width-of-road data storage 
section 1 3 are still more detailed data, and are data which asked for the width of road 
which changes according to the location of a road correctly. In addition, about the 
generation method of width-of-road data, it mentions later. 

[0046] The sensor section 14 contains various sensors required in order to detect the 
current position of a car. Specifically, it is constituted including the speed sensor 
which detects the rate of a car, the bearing sensor which detects the bearing variation 
of a car, the GPS receive section which receives the electric wave from a GPS (Global 
Positioning System) satellite. 

[0047] Based on the output signal from the sensor section 14, the current position 
detecting element 1 5 computes the current position of a car, and outputs current 
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position data. In addition, current position data are collated with the above-mentioned 
map data by the control section 11, and are amended by map matching processing etc. 
[0048] Under directions of a control section 1 1 , while map data are displayed in 
various modes, it superimposes on this and the current position of a car is displayed on 
a display 16 as a car mark. This display 16 consists of CRT, a liquid crystal display 
component, etc. Moreover, from a loudspeaker 17, while the induction information in 
alignment with the path of a car is outputted by voice, the below-mentioned guidance 
voice is outputted in relation to the image processing concerning this invention. 
[0049] The image-processing section 1 8 is a means to perform the image processing 
which analyzes the picture signal from two sets of CCD cameras 19a and 19b installed 
in a car, and starts this operation gestalt. Here, the configuration and actuation of the 
image-processing section 18 are explained using drawing 2 . 
[0050] As shown in drawin g 2 , the image-processing section 18 is constituted 
including A/D converter 21, the 1st image memory 22, the 2nd image memory 23, the 
movement vector detecting element 24, and the movement vector processing section 
- 25. Moreover, the image control section 18 operates according to the control signal 
from a control section 1 1 . In addition, although the image-processing section 1 8 
processes the picture signal from two sets of CCD cameras 19a and 19b like the after- 
mentioned in fact, since it is easy, it explains the case where the picture signal from 
one CCD camera 19a is processed. 

[005 1] In drawing 2 , A/D converter 21 changes into a digital image signal the analog 
picture signal based on the image picturized by CCD camera 19a. Usually, the digital 
image signal outputted from A/D converter 21 constitutes one frame image data for 
every predetermined frame period, and consists of two or more continuous frame 
image data. 

[0052] The 1st image memory 22 and the 2nd image memory 23 store the frame 
image data outputted from A/D converter 21, respectively. The 1st image memory 22 
stores the newest frame image data, and the 2nd image memory 23 stores the frame 
image data in front of one. Therefore, in the image-processing section 18, the newest 
image data for two frames is always held, and the below-mentioned processing is 
performed using these. 

[0053] The movement vector detecting element 24 detects the movement vector for 
every field in an image based on the frame image data stored in the 1 st image memory 
22 and the 2nd image memory 23. Under the present circumstances, the vehicle speed 
data outputted from the sensor section 14 are used. 

[0054] Moreover, based on the movement vector detected by the movement vector 
detecting element 24, the movement vector processing section 25 asks for the distance 
to the road edge in a transit road, and the width of road based on this, and outputs 
them as width-of-road data etc. 

[0055] In addition, about the detail of the processing in the movement vector detecting 
element 24 and the movement vector processing section 25, it mentions later. 
[0056] Returning to drawing 1 , CCD cameras 19a and 19b are installed near the both 
ends ahead of a car, respectively, picturize the right-and-left side of a car, and output a 
picture signal. The installation condition to the car of CCD cameras 19a and 19b is 
shown in drawing 3 here. 

[0057] Drawing 3 (a) is drawing showing the installation condition of CCD cameras 
19a and 19b seen from the car upper part. As shown in drawin g 3 (a), CCD cameras 
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19a and 19b are attached in the car-body upper part of right-and-left both sides at the 
car front side. CCD camera 19a is attached in car left-hand side, and CCD camera 19b 
is attached in car right-hand side, respectively. CCD camera 19a turns to the side on 
the left-hand side of a car, and is attached possible [ an image pick-up ], and CCD 
camera 1 9b turns to the side on the right-hand side of a car, is attached possible [ an 
image pick-up ], and is installed by respectively symmetrical arrangement. 
[0058] Moreover, drawing 3 (b) is drawing showing the installation condition seen 
from the car front with the image pick-up range about CCD camera 19a. In addition, 
since it is easy, only the image pick-up condition in the case of on the left-hand side of 
a car is shown. As shown in drawing 3 (b), CCD camera 1 9a picturizes the range of 
the field angle theta toward a wall surface. Usually, it is attached in the include angle 
at which a path road surface is reflected in the lower part while a upside wall surface 
is reflected in the picturized image. In this invention, the distance DL to a left-hand 
side road edge is computed based on the image picturized by CCD camera 1 9a. 
[0059] In addition, CCD camera 19a is attached in a location with a height [ of a car ] 
. of about lm. Moreover, in right-hand side CCD camera 19b, it will be in drawing 3 
(b) and a symmetrical image pick-up condition, and it will compute the distance DR to 
a right-hand side road edge. 

[0060] Next, the principle of the image processing concerning this operation gestalt is 
explained with reference to drawing 4 - drawing 8 . 

[0061] Drawin g 4 is drawing which expressed the image picturized by above- 
mentioned CCD cameras 19a and 19b with the model of a pinhole camera. In drawing 
4 , the image plane P0 corresponding to the photo detector section of CCD camera 1 9a 
and the focal plane F corresponding to the lens section separate a focal distance f, and 
are arranged in parallel. The lens core C of a focal plane F corresponds to a pinhole, 
and considers a space-coordinates system (X, Y, Z) centering on this lens core C. On 
the other hand, by the image plane P0, camera system of coordinates (x y) are 
considered by setting space coordinates (0, 0, -f) as the image core c. 
[0062] Here, the point M of a space-coordinates system (Xm, Ym, Zm) is considered. 
This point M can be made to correspond to the position on the wall surface in drawing 
3 (b). Considering the central projection over this point M, even an image plane P0 is 
connected in a straight line through the lens core C of a focal plane F from Point M, 
and it is projected on the point m of camera system of coordinates (xm, ym). At this 
time, the relation between Point M (Xm, Ym, Zm) and the projected point m (xm, ym) 
is expressed with a degree type. 
[0063] 

[Equation 1] xm = f-Xm/Zmym = It is drawing where drawing 5 expressed the 
relation between a space-coordinates system (X, Y, Z) and the pixel system of 
coordinates (u, v) of image data to the f-Ym/Zm order corresponding to drawing 4 . 
Since it is easy, while arranging the image plane P0 of drawing 4 to the front side of a 
focal plane F in drawin g 5 , it considers as a pixel image system (u, v) by reversing the 
x axis of camera system of coordinates (x y), and the y-axis, respectively, and 
considering as u shaft and v shaft. Even if it transposes arrangement of drawing 4 to 
arrangement of drawin g 5 , since it is mutually equivalent, the same relation is 
realized. 

[0064] In drawing 5 , the image plane PI of a pixel image system supports the display 
image of the horizontal number Nw of pixels, and the vertical number Nh of pixels, 
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and the pixel of NwxNh is contained in an image plane PI in all. On the other hand, 
this image plane PI is in agreement with the light-receiving field of CCD cameras 19a 
and 1 9b with which size is set to Breadth w and height h. And if the point M of a 
space-coordinates system (X, Y, Z) is considered like drawing 4 , as shown in drawing 
5 , it will be connected in a straight line to the lens core C of a focal plane F through 
the point m of an image plane PI (u, v). 

[0065] Here, considering the central projection over Point m, corresponding to several 
1, the relation between Point M (X, Y, Z) and the projected point m (u, v) is expressed 
with a degree type like drawing 4 . 
[0066] 

[Equation 2] u = (f-X/Z) -Nw/wv = (f-Y/Z) -Nh/h, several 2 [ i.e., ], expresses the 

pixel location in the image plane PI of Point m (u, v). In several 2, u corresponds to a 

horizontal pixel location and v supports the vertical pixel location. 

[0067] With this operation gestalt, since the image picturized from the car under 

transit is processed, it is necessary to assume a motion of the body in an image plane 

PI . Therefore, it is necessary to ask for the optical flow in an image plane PI, i.e., 

movement vector V, (u, v). When brightness I of the same point of three-dimension 

space is kept constant, the following differential equation between space-time is 

realized. 

[0068] 

[Equation 3] 

dl/dt = Ix-u+Iy-v+It = It corrects zero and a partial differential with horizontal Ix and 
Iy are [ a vertical partial differential and It of the partial differential of time amount 
shaft orientations, and u and v ] the components of horizontal [ of above-mentioned 
movement vector V ], and a perpendicular direction in an image plane PI, 
respectively. 

[0069] Next, how to ask for movement vector V using drawing 6 and drawing 7 is 
explained. As shown in drawin g 6 , reference block R is defined in the image plane PI 
in time of day t. With the upper left pixel pr as the starting point, this reference block 
R is the rectangle field of the range of n pixels, and contains the pixel of a mxn 
individual in u shaft in all at m pixels and v shaft. And an image plane PI is divided 
into two or more reference block R, and each reference block R of every is asked for 
movement vector V. The example of drawin g 6 shows reference block R used as m= 8 
and n= 8. 

[0070] Drawing 7 is drawing explaining how to ask for movement vector V to 
predetermined reference block R in an image plane PI . Drawing 7 corresponds to the 
image plane PI in time-of-day t+delta t in which deltat has passed since the time of 
day t of drawing 6 . And based on the vehicle speed data from the sensor section 14 
etc., the predetermined field in an image plane PI is beforehand appointed as search 
range S. The search range S is a rectangle field where it becomes M pixels on u shaft, 
and it becomes v shaft with N pixel, and M and N usually become sufficiently large 
compared with m and n. 

[0071] And comparison Brock C of reference block R and the same size is defined as 
a position to the search range S. Since size is sufficiently large compared with 
reference block R, it is necessary, as for the search range S, to move comparison 
Brock's C location little by little in the search range S. By drawing 7 , comparison 
Brock C is the size of mxn like reference block R, and shows the pixel pc at the upper 
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left of comparison Brock C corresponding to the pixel pr at the upper left of a 
reference block. The pixel at the upper left of the search range S is set as comparison 
Brock's C pixel pc at first, after that, in the search range S, it moves 1 pixel of 
locations of Pixel pc at a time to u shaft orientations or v shaft orientations, and the 
below-mentioned operation is performed about all comparison Brock C that can give a 
definition in the search range S. 

[0072] Subsequently, a correlation value is calculated among comparison Brock C in 
reference block R in the time of day t of drawin g 6 , and time-of-day t+delta t of 
drawing 7 . Here, in the image data which is the set of a pixel, since the concentration 
value is made to correspond to all the pixels of a mxn individual, it asks for the 
difference of the concentration value for every pixel to which reference block R and 
comparison Brock C correspond. A correlation value is calculable if the sum about the 
pixel of a mxn individual is taken to the difference for every pixel of this 
concentration value. 

[0073] And to reference block R, the correlation value between all comparison Brock 
C in the search range S is calculated, and it looks for comparison Brock C who gives 
the minimum correlation value. For example, suppose that comparison Brock C who 
shows drawin g 7 gives the minimum correlation value. 

[0074] In this case, as shown in drawing 7 , in an image plane PI, the vector which 
turns on comparison Brock C in time-of-day t+delta t from reference block R in the 
time of day t shown by the dotted line can be determined as movement vector V. 
[0075] Although drawin g 7 showed only one movement vector V, it asks for 
movement vector V in fact about all reference block R which can be defined as an 
image plane PL This searches for spatial distribution of movement vector V. And the 
below-mentioned processing is performed based on spatial distribution of this 
movement vector V. 

[0076] Next, the above-mentioned distance DR and DL and the calculation approach 
of the width of road are explained using drawin g 8 . Drawin g 8 is drawing showing an 
example of distribution of movement vector V in the image picturized from CCD 
camera 19a. In drawing 8 , since it is easy, in the longitudinal direction of a car, the 
case where the path road surface and the wall surface have touched in the boundary 
section 30 is assumed like drawing 3 (b). Moreover, distribution of movement vector 
V on Rhine LI in time of day t is considered. 

[0077] As shown in drawing 8 , in the image picturized in CCD camera 19a, the 
magnitude of movement vector V is changing with the rate of change of abbreviation 
regularity by the path road surface in the lower part of the boundary section 30 to the 
magnitude of movement vector V serving as constant value on the wall surface in the 
upper part of the boundary section 30. Thus, the magnitude of movement vector V 
serves as a value depending on the distance z to a photography object. 
[0078] That is, supposing it performs the image pick-up by CCD camera 19a by frame 
period T in the car it is running at a rate vO (m/second), the migration length d of a 1 
inter-frame car is [0079]. 
[Equation 4] d = vOandT (m) 

It can express. Here, if a photography object considers the situation which does not 
change only in the direction of u in a motion, the direction of v, and the direction of z 
relatively [ car ], the following formulas will be realized that what is necessary is 
several 2 just to substitute above-mentioned x=d. 
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[0080] 

[Equation 5] u = (f-d/z) -Nw/w = (f-vO.T/z) It can express -Nw/w. Movement vector V 
(u, 0) becomes settled by u shown in several 5, and this u is in agreement with the 
magnitude of movement vector V. Thus, the magnitude of movement vector V is in 
inverse proportion to the distance z with a photography object. 

[008 1] Drawing 9 is drawing in which the magnitude of movement vector V of Rhine 
LI shows signs that it changes corresponding to several 5. In drawing 9 , while a 
continuous line shows the magnitude of the movement vector of a photography object 
to v shaft in the image of drawing 8 , the dotted line shows distance z. Since distance z 
becomes fixed, on a wall surface, it becomes fixed [ the magnitude of movement 
vector V ], so that drawing 8 may show. On the other hand, since it becomes small at a 
rate of abbreviation regularity so that distance z goes by the path road surface caudad, 
several 5 u becomes large linearly. 

[0082] Therefore, in drawin g 9 , movement vector V cannot change with the rate of 
change of abbreviation regularity, but can distinguish a wall surface and a path road 
surface based on whether it becomes in general fixed, and can also judge the location 
of the boundary section 30. And MV (pixel), then the distance DL to the above- 
mentioned wall surface are based on several 5 in the average of movement vector V of 
a wall surface, and it is [0083]. 
[Equation 6] 

DL = (f-vO.T/MV) -Nw/w can be computed and calculated. 
[0084] In addition, although movement vector V becomes small with the rate of 
change of abbreviation regularity as it goes above an image by the path road surface 
when a slot exists in a road edge, on the boundary of a path road surface and a slot, it 
changes uniformly [ rate of change ] and rapidly partially. Therefore, a slot can be 
detected by distinguishing this break point, and the distance DL to a road edge can be 
found based on the magnitude of movement vector V before and behind that. 
[0085] Moreover, what is necessary is to generate two or more fields where movement 
vector V becomes in general fixed, when becoming a partial wall surface like the 
guard rail instead of a single wall surface, but just to use the distance DL which finds 
the distance DL about two or more fields, among those serves as the shortest, while 
detecting a break point as mentioned above. Also when a guard rail adjoins a road 
edge, the distance DL of a road edge can be found based on the distance to the field 
corresponding to a guard rail. 

[0086] In addition, as an example of each numeric value in several 5, it becomes focal 
distance f= 4 (mm), horizontal pixel number Nw=320 (pixel), and breadth [ of a light- 
receiving field ] w=4(mm) frame period T=l / 30 (second) extent. . 
[0087] If the above image processing is similarly performed to the image by two CCD 
cameras 19a and 19b, the distance DL and DR to the road edge in right and left of a 
car will be found. Therefore, while adding these, in consideration of the breadth of a 
car, the width of road in the road under transit is further computable. For example, 
when a car has Breadth W in the installation condition of drawing 2 (b), the width of 
road RW is [0088]. 

[Equation 7] RW ** It can ask in approximation with DL+DR+W. 
[0089] In addition, if the width-of-road data corresponding to the computed width of 
road RW are related with map data and memorized possible [ updating ] in the width- 
of-road data storage section 13, it can use for various kinds of below-mentioned 
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processings. 

[0090] Next, the concrete image processing in the navigation equipment concerning 
this operation gestalt is explained with reference to drawing 10 and drawing 1 1 . 
Drawin g 10 is a flow chart which shows processing for the car under transit to prevent 
approaching a road edge, and drawing 1 1 is a flow chart which shows processing for 
the car under transit the road of two or more lanes to make it run a proper lane to a 
setting path. In addition, drawing 10 and drawing 1 1 are processings mainly 
performed according to control of a control section 1 1 . 

[0091] If the processing shown in drawing 10 is started, the distance DL and DR to the 
road edge of both sides will be found, and the width of road RW will be computed by 
processing of the above image-processing sections 18 according to several 7 based on 
this (step SI). And the width-of-road data corresponding to the width of road RW 
computed at step S 1 are related with map data, and are written in the width-of-road 
data storage section 13 (step S2). At this time, it may be made to write in width-of- 
road data in the predetermined point path on the street set up beforehand. 
[0092] Subsequently, based on the distance DL and DR acquired in step SI, it is 
judged whether the car under transit visits a road edge too much (step S3), namely, 
what is necessary is to set up a predetermined distance used as criteria, and just to 
judge that a car visits a road edge too much and comes out to it, when distance DL or 
DR serves as a small value from this predetermined distance 
[0093] When the decision result of step S3 is "YES", a car visits a road edge too 
much, and comes out to it, and it warns a driver of a certain thing (step S4). For 
example, what is necessary is just to output as voice the predetermined message which 
visits a road edge too much, comes out to it, and shows a certain purport from a 
loudspeaker 17. Or the same message or a display notation may be displayed on a 
display 16. 

[0094] After finishing step S4 when the decision result of step S3 is "NO" or, it judges 
whether a car is running or not (step S5). When a car is not running (step S5; NO), 
since it is not necessary to perform an image processing, processing is finished. On the 
other hand, when a car is still running (step S5; YES), processing of step SI - step S5 
is repeated. 

[0095] In navigation equipment, real time can be asked for the always exact width of 
road RW by processing the above step SI - step S5. And since it was made to warn a 
driver when the distance DL and DR to a road edge was supervised and the car under 
transit visited a road edge too much, operation of a driver can be assisted and the 
insurance under transit can be secured. Moreover, since width-of-road data were 
suitably written in the width-of-road data storage section 13, when running the behind 
same road, it becomes possible to utilize width-of-road data effectively. 
[0096] Next, the desired destination is set as navigation equipment and processing 
shown in drawing 1 1 is performed under the situation that a path is judged. First, like 
step SI, the distance DL and DR to the road edge of both sides is found, and the width 
of road RW is computed further (step S 1 1). 

[0097] And the lane information over the lane under transit included in the map data 
of the map data storage section 12 is read (step SI 2). Since the road under transit is 
the information which shows **** with what lane, this lane information judges 
whether the roads under transit are two or more lanes based on lane information (step 
S13). 
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[0098] When the decision result of step S13 is "YES", based on the decision result of 
step SI 1, it judges which lane is under transit among two or more lanes now (step 
SI 4). This judgment can be performed based on a ratio with the distance DL and DR 
to the road edge of the both sides of the car for which it asked at step S 1 . 
[0099] Then, the lane judged at step S 14 judges whether it is a proper lane 
corresponding to the path which arrives at the destination (step SI 5). That is, if the 
case where it is running the road of three lanes, for example is taken for an example, 
you may be which lane when a right-hand side lane becomes proper when turning to 
the right ahead generally, a left-hand side lane serves as fitness when turning left 
ahead, and going straight on as it is. Or the information on the proper lane at the time 
of left turn and right-turn may be set up beforehand. 

[0100] As a result of the judgment of step SI 5, when the car is running the proper 
lane, processing (step S15; YES) is finished. On the other hand, when the car is 
running the lane which is not proper, guidance of lane modification is directed to (step 
SI 5; NO) and a driver (step SI 6). for example, the case where it is running the left- 
hand side lane before the right-turn point — already ~ what is necessary is to output as 
voice the message of a purport which urges moving to 2 lane right to a driver from a 
loudspeaker 17, or just to display it on a display 16 

[0101] In navigation equipment, the lane in which a car is located by the road of two 
or more lanes can be judged on real time by processing the above step SI 1 - step SI 6. 
And unnecessary guidance does not need to be performed, when guidance is 
performed only when required and it has already run the proper lane, since it was 
made to guide lane modification to a driver only when it was not located in a proper 
lane, in order to perform right-turn, left turn, etc. Therefore, convenience is high and 
much more comfortable navigation becomes realizable for a driver. 
[0102] In addition, in the example of drawing 1 1 , only while the car is running the 
lane which is not proper, when directing guidance of lane modification, namely, while 
running the proper lane, the case where guidance of lane modification was not directed 
was explained, but it is not restricted to this, but while [ when a car is proper ] 
running, it may be made to perform a certain guidance. For example, while running a 
proper lane, guidance of "please maintain the lane of this as" may be outputted with 
voice etc. Thereby, the driver under operation can be made to be able to grasp running 
the proper lane, and sense of security can be given to it. 

[0103] As mentioned above, although this invention was explained based on the 
operation gestalt, this invention is not limited to the above-mentioned operation gestalt 
at all, and it can guess it easily for amelioration deformation various by within the 
limits which does not deviate from the meaning of this invention to be possible. 
[0104] For example, you may make it display the image picturized with CCD cameras 
19a and 19b as an image pick-up means on a display 16. With this operation gestalt, 
since it is installed so that CCD cameras 19a and 19b may picturize the just beside 
direction in the car front, before a driver arrives at the location which can see the side 
directly, on a display 16, a side image is checked by looking and the thing of it can be 
carried out. Especially when a car advances into a crossing from a narrow alley, a side 
image can be checked by looking only by taking out a car tip to a crossing slightly, 
and it becomes useful at insurance transit of a car. 

[0105] Moreover, although the above-mentioned operation gestalt explained the case 
where it was installed so that CCD cameras 1 9a and 1 9b as an image pick-up means 
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may picturize the just beside direction in the side of a car, it is not restricted to this, 
but you may install so that the direction of before [ slant ] approach in the side of a car 
may be picturized. Thereby, a side image can be preceded in time, and can be 
processed and the distance to a road edge can be found timely. 
[0106] Or you may install so that the direction [ in / for CCD cameras 19a and 19b / 
the side of a car ] of the bottom approach of slant may be picturized. Generally, if 
CCD cameras 1 9a and 1 9b with a vertical narrow field angle are used, when a car 
approaches a road edge, the case where a road edge stops entering in an image will 
arise, in such a case, since it comes out, and a road edge will enter in an image if the 
image pick-up direction of CCD cameras 1 9a and 1 9b comes together the bottom and 
there comes out and is even if it is, it becomes possible to find the distance to a road 
edge. 

[0107] Moreover, CCD cameras 19a and 19b which have a larger field angle may be 
used. For example, when a horizontal field angle performs above-mentioned 
processing separately to the left-hand side field and the right-hand side field in each 
image pick-up image using some CCD cameras 19a and 19b about 180 degrees, the 
distance to a road edge may be found. The distance to a road edge can be found 
thereby still more finely. 
[0108] 

[Effect of the Invention] Since according to this invention the side of the car under 
transit is picturized with an image pick-up means, an image processing is performed 
and the distance to a road edge was found as explained above, the security of a transit 
car, acquisition of width-of-road data, etc. become possible [ raising the safety and 
convenience of a car ]. 

[0109] Moreover, if this invention is applied to navigation equipment, it will become 
possible to support navigation equipment and to aim at improvement in functional by 
the notice to the driver at the time of road edge contiguity of a car, the notice of lane 
modification based on a lane judging, a width-of-road data storage, etc. 

[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



TECHNICAL FIELD 

[Field of the Invention] This invention belongs to the technical field of the image 
processing system and the image-processing approach of asking for the distance and 
the width of road to a road edge based on the picture signal from an image pick-up 
means, and navigation equipment in the car under transit. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation . 

1 .This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 

PRIOR ART 

[Description of the Prior Art] The navigation equipment which displays the current 
position which detected the current position of the car as a mobile and was detected 
with the surrounding road map from the former on a display screen, and performs path 
guidance is used widely. In this kind of navigation equipment, it has the mass record 
medium with which map data were memorized, and it is used in order to generate the 
indicative data on a display screen. In addition to data, various data for a display, etc. 
about a road configuration, the width-of-road information which accompanies this is 
included in the map data on a record medium. Therefore, the width-of-road 
information corresponding to the road under transit can be read, and the width of road 
of the road it is running now can be grasped. 

[Translation done.] 
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JPO and NCIPI are not responsible for any 
damages caused by -the use of this -translation. 

1 .This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 

EFFECT OF THE INVENTION 

[Effect of the Invention] Since according to this invention the side of the car under 
transit is picturized with an image pick-up means, an image processing is performed 
and the distance to a road edge was found as explained above, the security of a transit 
car, acquisition of width-of-road data, etc. become possible [ raising the safety and 
convenience of a car ] . 

[0109] Moreover, if this invention is applied to navigation equipment, it will become 
possible to support navigation equipment and to aim at improvement in functional by 
the notice to the driver at the time of road edge contiguity of a car, the notice of lane 
modification based on a lane judging, a width-of-road data storage, etc. 

[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 

TECHNICAL PROBLEM 

[Problem(s) to be Solved by the Invention] However, with the above-mentioned 
conventional navigation equipment, the width-of-road information included in map 
data does not show the exact width of road, and showed the width of road of the 
outline of the road like 5.5m-8m with it. Therefore, the fine exact width-of-road 
information corresponding to the point of a road was unacquirable. Furthermore, it not 
only gets to know the width of road of a road, but it asks real time for the distance to a 
road, and the needs for using this for insurance transit of a car are strong. 
[0004] Then, this invention is made in view of such a problem. The purpose is 
offering the navigation equipment which can perform warning and the guidance for 
securing insurance transit to a driver according to the result of the image processing 
system for mount which can ask for the distance and the width of road to a road edge , 
and an image processing by detecting the structures other than the path road surface 
which adjoins a wall surface , and a slot or a path road surface out of an image based 
on the image picturized from the car under transit . 

[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation . 

1. This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



MEANS 

[Means for Solving the Problem] In order to solve the above-mentioned technical 
problem, an image processing system according to claim 1 An image pick-up means 
to picturize the side of a mobile and to output a picture signal, and a movement vector 
detection means to detect a movement vector for every field of the picturized image 
based on said picture signal which a mobile is moving, The spatial rate of change of 
the magnitude of said detected movement vector is distinguished, and it is 
characterized by having a distance calculation means to compute the distance to a road 
edge based on this rate of change. 

[0006] According to this invention, with an image processing system, in mobiles, such 
as a car under transit, the image pick-up by the image pick-up means is performed 
towards the side, and a picture signal is outputted. This picture signal is compared at 
the two times, and the movement vector for every field is detected. Although the rate 
of change of a movement vector serves as abbreviation regularity in parts for a 
horizontal level, such as a path road surface in an image, the break point of rate of 
change arises at a road edge. Therefore, it can distinguish for every fields of these, a 
road edge can be distinguished, and the distance to a road edge can be further 
computed based on the magnitude of a movement vector. Therefore, the computed 
distance is available for applications, such as security under transit, and exchange of 
navigation, and can raise the safety and convenience of a car. 

[0007] Said distance calculation means is characterized by computing the 1st distance 
to a left-hand side road edge, and the 2nd distance to a right-hand side road edge 
including 1 st image pick-up means by which, as for said image pick-up means, an 
image processing system according to claim 2 picturizes the left-hand side side of a 
mobile in an image processing system according to claim 1 , and the 2nd image pick- 
up means which picturizes the right-hand side side of a mobile. 

[0008] Towards left-hand side, towards right-hand side, the 2nd image pick-up means 
picturizes, respectively, and, according to this invention, the 1 st image pick-up means 
outputs a picture signal by mobiles, such as a car under transit. Like invention 
according to claim 1, subsequent processing is performed about a right-hand side 
image and a left-hand side image, and can compute the distance to the both-sides road 
edge of a mobile. Therefore, two computed distance is acquired, and grasp of the car 
location in a transit road becomes easy, and can raise the safety and convenience of a 
car further. 

[0009] An image processing system according to claim 3 is characterized by having 
further a width-of-road calculation means to compute the width of road of the transit 
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road of a mobile, based on said the 1st distance and said 2nd distance in an image 
processing system according to claim 2. 

[0010] According to this invention, based on two distance computed corresponding to 
the image of the right and left in mobiles, such as a car, the width of road of a transit 
road is computable. For example, when the image pick-up means is installed in the 
flank of car both sides, if two distance is applied and the distance between image pick- 
up means is applied further, the width of road will be obtained. Therefore, using this 
width of road, the insurance under transit is secured or it becomes useful to the 
improvement in functional of the security and navigation of a car, such as acquiring 
width-of-road data. 

[001 1] Said picture signal is constituted considering the frame image data in which an 
image processing system according to claim 4 has a predetermined frame period in an 
image processing system given in either of claim 1 to claims 3 as a unit, and said 
movement vector detection means is characterized by detecting said movement vector 
based on two continuous frame image data. 

[0012] According to this invention, the object of an image processing is frame image 
data outputted for every frame period, and an above-mentioned image processing is 
performed using two continuous frame image data. Therefore, an image processing is 
always carried out to real time during transit of a car, and the image processing system 
which can respond to the situation of a car promptly can be realized. 
[0013] An image processing system according to claim 5 is characterized by being 
installed in a before [ a mobile ] side by said image pick-up means in an image 
processing system given in either of claim 1 to claims 4. 

[0014] displaying the picture signal from the image pick-up means installed in the 
before [ a mobile ] side on the display screen according to this invention ~ the above- 
mentioned operation — in addition, a check by looking usually checks easily the 
longitudinal direction by the side of before [ difficult ] a mobile by looking — things 
can be carried out and it becomes much more useful at the security of a car. 
[0015] An image processing system according to claim 6 is characterized by said 
image pick-up means picturizing the side of the approach before slant of a mobile in 
an image processing system given in either of claim 1 to claims 5. 
[0016] Since it was made to perform above-mentioned processing based on the picture 
signal from an image pick-up means to picturize the approach before slant of a mobile 
according to this invention, the distance to the road edge in the travelling direction 
front of a car can be computed by preceding it in time, and the run state of a car can be 
grasped quickly. 

[0017] An image processing system according to claim 7 is characterized by said 
image pick-up means picturizing the side of the bottom approach of slant of a mobile 
in an image processing system given in either of claim 1 to claims 6. 
[0018] Since it was made to perform above-mentioned processing based on the picture 
signal from an image pick-up means to picturize the bottom approach of slant of a 
mobile according to this invention, even if it is the case where a road edge is 
approached, into a field angle, it becomes easy to catch a road edge and the safety of a 
transit car can be raised further. 

[0019] The image-processing approach according to claim 8 is the image-processing 
approach of performing an image processing based on the picture signal outputted 
from an image pick-up means to picturize the side of a mobile. The movement vector 
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detection process of detecting a movement vector for every field of the picturized 
image based on said picture signal which a mobile is moving, The spatial rate of 
change of the magnitude of said detected movement vector is distinguished, and it is 
characterized by having the distance calculation process which computes the distance 
to a road edge based on this rate of change. 

[0020] According to this invention, the picture signal from the image pick-up means 
installed in mobiles, such as a car under transit, is inputted, according to the same 
operation as invention according to claim 1, a road edge can be distinguished and the 
distance to a road edge can be further computed based on the magnitude of a 
movement vector. Therefore, the computed distance is available for applications, such 
as security under transit, and exchange of navigation, and can raise the safety and 
convenience of a car. 

[0021] The image-processing approach according to claim 9 is outputted for said 
picture signal in the image-processing approach according to claim 8, respectively 
from the 1st image pick-up means which picturizes the left-hand side side of a mobile, 
and the 2nd image pick-up means which picturizes the right-hand side side of a 
mobile, and said distance calculation process is characterized by computing the 1st 
distance to a left-hand side road edge, and the 2nd distance to a right-hand side road 
edge. 

[0022] According to this invention, the picture signal corresponding to the left-hand 
side side from the 1st image pick-up means installed in mobiles, such as a car under 
transit, and the picture signal corresponding to the right-hand side side from the 2nd 
image pick-up means are inputted, respectively, and the distance to the both-sides road 
edge of a mobile can be computed according to the same operation as invention 
according to claim 2. Therefore, two computed distance is acquired, and grasp of the 
car location in a transit road becomes easy, and can raise the safety and convenience 
of a car further. 

[0023] The image-processing approach according to claim 10 is characterized by 
having further the width-of-road calculation process which computes the width of road 
of the transit road of a mobile based on said the 1st distance and said 2nd distance in 
the image-processing approach according to claim 9. 

[0024] According to this invention, it becomes useful to the improvement in 
functional of the security and navigation of a car, such as the width of road of a transit 
road being computable, and securing the insurance under transit or acquiring width-of- 
road data using this width of road, according to the same operation as invention 
according to claim 3. 

[0025] Said picture signal is constituted considering the frame image data in which the 
image-processing approach according to claim 1 1 has a predetermined frame period in 
the image-processing approach given in either of claim 8 to claims 10 as a unit, and 
said movement vector detection process is characterized by detecting said movement 
vector based on two continuous frame image data. 

[0026] Since an above-mentioned image processing is performed by the same 
operation as invention according to claim 4 using two continuous frame image data 
according to this invention, an image processing is always carried out to real time 
during transit of a car, and the image-processing approach which can respond to the 
situation of a car promptly can be offered. 

[0027] The sensor section which navigation equipment according to claim 12 is 
http://www4ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 1/12/2005 



Page 4 of 13 



navigation equipment which performs path guidance from the current position of a car 
to the destination based on map data, and contains the speed sensor which detects the 
passing speed of a car, An image pick-up means to picturize the side of a car and to 
output a picture signal, and a movement vector detection means to detect a movement 
vector for every field of the picturized image based on said picture signal under car 
transit, The spatial rate of change of the magnitude of said detected movement vector 
is distinguished, and it is characterized by having a distance calculation means to 
compute the distance to a road edge based on this rate of change and said passing 
speed. 

[0028] According to this invention, while the passing speed of a car is detected by the 
sensor section of navigation equipment, the image pick-up by the image pick-up 
means is performed towards the car side, and a picture signal is outputted. And the 
image processing by the same operation as invention according to claim 1 is 
performed. Therefore, it can utilize effective in reservation of safety, or other various 
functions, and the computed distance can raise the safety and convenience of a car. 
[0029] In navigation equipment according to claim 12, navigation equipment 
according to claim 1 3 is characterized by having further a notice means to notify of 
the car having approached the road edge, when said computed distance is smaller than 
the value set up beforehand. 

[0030] According to this invention, with navigation equipment, since it judges that the 
car approached the road edge too much based on the distance to a road edge and the 
driver was notified of that, the safety and convenience of a car can be raised further. 
[0031] Navigation equipment according to claim 14 is characterized by having further 
a width-of-road calculation means to compute the width of road of the transit road of a 
car in navigation equipment according to claim 12 or 13. 

[0032] When according to this invention the width of road of a transit road can be 
computed, for example, the image pick-up means is installed in the flank of car both 
sides by the car it runs, if two distance is applied and the width of face of a car is 
applied further, the width of road will be obtained. Therefore, it becomes useful to the 
improvement in functional of the security and navigation of a car to secure the 
insurance under transit, or to acquire width-of-road data, to relate with map data and to 
hold using this width of road, etc. 

[0033] Navigation equipment according to claim 15 is characterized by having further 
a width-of-road data storage means to relate the width-of-road data corresponding to 
said computed width of road with said map data, and to memorize them possible 
[ updating ] in navigation equipment according to claim 14. 
[0034] According to this invention, with the navigation equipment for mount, it 
memorizes possible [ updating of the width-of-road data corresponding to the width of 
road for which the width-of-road data storage means was asked as mentioned above ]. 
Therefore, since it can utilize when the width-of-road data of the road the car ran are 
held and it passes along the road same after that again, the function of navigation 
equipment is supportable. 

[0035] Navigation equipment according to claim 16 is characterized by having further 
a slow lane judging means to judge the slow lane of a car based on the calculation 
result of said distance calculation means and said width-of-road calculation means, 
and a lane notice means to notify of the proper lane should collate said judged slow 
lane with the optimal path to said destination, and it should run based on this collating 
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result in navigation equipment according to claim 14 or 15. 

[0036] According to this invention, with navigation equipment, while a car runs the 
road of two or more lanes, the slow lane is judged based on the distance and the width 
of road to a road edge. And the judged lane is collated with an optimal path and 
notifies a driver of the proper lane it should run based on the result. Therefore, since it 
is made to run the lane corresponding to an optimal path, attention of a driver can be 
called, and a comfortable navigation function can be realized. 

[0037] the case where, as for said lane notice means, said judged slow lane does not 
agree into said proper lane in navigation equipment according to claim 16 in 
navigation equipment according to claim 17 — this — it is characterized by notifying of 
a proper lane. 

[0038] According to this invention, the judged lane is collated with an optimal path by 
the same operation as invention according to claim 16, and when it is judged that it is 
not running the lane where a car is proper, a driver is notified of a proper lane. 
Therefore, avoiding the unnecessary notice at the time of running the proper lane, a 
necessary minimum notice is performed and a comfortable navigation function can be 
realized. 

[0039] the case where, as for said lane notice means, said judged slow lane agrees into 
said proper lane in navigation equipment according to claim 16 in navigation 
equipment according to claim 18 — this ~ it is characterized by notifying of agreeing 
into a proper lane. 

[0040] According to this invention, the judged lane is collated with an optimal path by 
the same operation as invention according to claim 16, and when [ at which it is 
running the lane where a car is proper ] judged, a driver is notified of that. Therefore, a 
driver is made to know running the proper lane and the comfortable navigation 
function to give sense of security to a driver can be realized. 
[0041] 

[Embodiment of the Invention] Hereafter, the gestalt of suitable operation of this 
invention is explained based on a drawing. In the gestalt of the following operations, 
the case where it applies to the navigation equipment in which this invention is carried 
by the car is explained. 

[0042] Drawin g 1 is drawing showing the outline configuration of the navigation 
equipment concerning this operation gestalt. The navigation equipment shown in 
drawin g 1 is constituted including a control section 1 1 , the map data storage section 
12, the width-of-road data storage section 13, the sensor section 14, the current 
position detecting element 15, a display 16, a loudspeaker 17, the image-processing 
section 18, and CCD cameras 19a and 19b. 

[0043] In the above configuration, a control section 1 1 controls actuation of the whole 
navigation equipment. A control section 1 1 outputs and inputs data while it reads and 
performs the control program which consists of a CPU etc. and is stored in ROM 
which is not illustrated and sends out a control signal to each component of navigation 
equipment. 

[0044] The map data storage section 12 is memory with the big storage capacity which 
stores map data, for example, CD-ROM and DVD-ROM are used. The map data 
stored in the map data storage section 12 are constituted including road configuration 
data, name data, background data, etc. 

[0045] The width-of-road data storage section 13 is memory recorded possible 
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[ updating of the width-of-road data under car transit obtained in connection with the 
image processing concerning this invention ]. Although simple width-of-road 
information is included also in the map data of the above-mentioned map data storage 
section 12, the width-of-road data memorized by the width-of-road data storage 
section 13 are still more detailed data, and are data which asked for the width of road 
which changes according to the location of a road correctly. In addition, about the 
generation method of width-of-road data, it mentions later. 

[0046] The sensor section 14 contains various sensors required in order to detect the 
current position of a car. Specifically, it is constituted including the speed sensor 
which detects the rate of a car, the bearing sensor which detects the bearing variation 
of a car, the GPS receive section which receives the electric wave from a GPS (Global 
Positioning System) satellite. 

[0047] Based on the output signal from the sensor section 14, the current position 
detecting element 1 5 computes the current position of a car, and outputs current 
position data. In addition, current position data are collated with the above-mentioned 
map data by the control section 1 1, and are amended by map matching processing etc. 
[0048] Under directions of a control section 11, while map data are displayed in 
various modes, it superimposes on this and the current position of a car is displayed on 
a display 16 as a car mark. This display 16 consists of CRT, a liquid crystal display 
component, etc. Moreover, from a loudspeaker 17, while the induction information in 
alignment with the path of a car is outputted by voice, the below-mentioned guidance 
voice is outputted in relation to the image processing concerning this invention. 
[0049] The image-processing section 1 8 is a means to perform the image processing 
which analyzes the picture signal from two sets of CCD cameras 19a and 19b installed 
in a car, and starts this operation gestalt. Here, the configuration and actuation of the 
image-processing section 1 8 are explained using drawing 2 . 
[0050] As shown in drawing 2 , the image-processing section 18 is constituted 
including A/D converter 21, the 1st image memory 22, the 2nd image memory 23, the 
movement vector detecting element 24, and the movement vector processing section 
25. Moreover, the image control section 18 operates according to the control signal 
from a control section 1 1 . In addition, although the image-processing section 1 8 
processes the picture signal from two sets of CCD cameras 19a and 19b like the after- 
mentioned in fact, since it is easy, it explains the case where the picture signal from 
one CCD camera 19a is processed. 

[0051] In drawing 2 , A/D converter 21 changes into a digital image signal the analog 
picture signal based on the image picturized by CCD camera 1 9a. Usually, the digital 
image signal outputted from A/D converter 21 constitutes one frame image data for 
every predetermined frame period, and consists of two or more continuous frame 
image data. 

[0052] The 1st image memory 22 and the 2nd image memory 23 store the frame 
image data outputted from A/D converter 21, respectively. The 1st image memory 22 
stores the newest frame image data, and the 2nd image memory 23 stores the frame 
image data in front of one. Therefore, in the image-processing section 18, the newest 
image data for two frames is always held, and the below-mentioned processing is 
performed using these. 

[0053] The movement vector detecting element 24 detects the movement vector for 
every field in an image based on the frame image data stored in the 1 st image memory 
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22 and the 2nd image memory 23. Under the present circumstances, the vehicle speed 
data outputted from the sensor section 14 are used. 

[0054] Moreover, based on the movement vector detected by the movement vector 
detecting element 24, the movement vector processing section 25 asks for the distance 
to the road edge in a transit road, and the width of road based on this, and outputs 
them as width-of-road data etc. 

[0055] In addition, about the detail of the processing in the movement vector detecting 
element 24 and the movement vector processing section 25, it mentions later. 
[0056] Returning to drawin g 1 , CCD cameras 19a and 19b are installed near the both 
ends ahead of a car, respectively, picturize the right-and-left side of a car, and output a 
picture signal. The installation condition to the car of CCD cameras 19a and 19b is 
shown in drawing 3 here. 

[0057] Drawing 3 (a) is drawing showing the installation condition of CCD cameras 
19a and 19b seen from the car upper part. As shown in drawin g 3 (a), CCD cameras 
19a and 19b are attached in the car-body upper part of right-and-left both sides at the 
car front side. CCD camera 1,9a is attached in car left-hand side, and CCD camera 19b 
is attached in car right-hand side, respectively. CCD camera 1 9a turns to the side on 
the left-hand side of a car, and is attached possible [ an image pick-up ], and CCD 
camera 19b turns to the side on the right-hand side of a car, is attached possible [ an 
image pick-up ], and is installed by respectively symmetrical arrangement. 
[0058] Moreover, drawing 3 (b) is drawing showing the installation condition seen 
from the car front with the image pick-up range about CCD camera 19a. In addition, 
since it is easy, only the image pick-up condition in the case of on the left-hand side of 
a car is shown. As shown in drawing 3 (b), CCD camera 19a picturizes the range of 
the field angle theta toward a wall surface. Usually, it is attached in the include angle 
at which a path road surface is reflected in the lower part while a upside wall surface 
is reflected in the picturized image. In this invention, the distance DL to a left-hand 
side road edge is computed based on the image picturized by CCD camera 19a. 
[0059] In addition, CCD camera 19a is attached in a location with a height [ of a car ] 
of about lm. Moreover, in right-hand side CCD camera 19b, it will be in drawing 3 
(b) and a symmetrical image pick-up condition, and it will compute the distance DR to 
a right-hand side road edge. 

[0060] Next, the principle of the image processing concerning this operation gestalt is 
explained with reference to drawin g 4 - drawin g 8 . 

[0061] Drawin g 4 is drawing which expressed the image picturized by above- 
mentioned CCD cameras 19a and 19b with the model of a pinhole camera. In drawin g 
4 , the image plane P0 corresponding to the photo detector section of CCD camera 19a 
and the focal plane F corresponding to the lens section separate a focal distance f, and 
are arranged in parallel. The lens core C of a focal plane F corresponds to a pinhole, 
and considers a space-coordinates system (X, Y, Z) centering on this lens core C. On 
the other hand, by the image plane P0, camera system of coordinates (x y) are 
considered by setting space coordinates (0, 0, -f) as the image core c. 
[0062] Here, the point M of a space-coordinates system (Xm, Ym, Zm) is considered. 
This point M can be made to correspond to the position on the wall surface in drawin g 
3 (b). Considering the central projection over this point M, even an image plane P0 is 
connected in a straight line through the lens core C of a focal plane F from Point M, 
and it is projected on the point m of camera system of coordinates (xm, ym). At this 
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time, the relation between Point M (Xm, Ym, Zm) and the projected point m (xm, ym) 

is expressed with a degree type. 

[0063] 

[Equation 1] xm = f-Xm/Zmym = It is drawing where drawing 5 expressed the 
relation between a space-coordinates system (X, Y, Z) and the pixel system of 
coordinates (u, v) of image data to the f-Ym/Zm order corresponding to drawing 4 . 
Since it is easy, while arranging the image plane P0 of drawing 4 to the front side of a 
focal plane F in drawing 5 , it considers as a pixel image system (u, v) by reversing the 
x axis of camera system of coordinates (x y), and the y-axis, respectively, and 
considering as u shaft and v shaft. Even if it transposes arrangement of drawing 4 to 
arrangement of drawing 5 , since it is mutually equivalent, the same relation is 
realized. 

[0064] In drawin g 5 , the image plane PI of a pixel image system supports the display 
image of the horizontal number Nw of pixels, and the vertical number Nh of pixels, 
and the pixel of NwxNh is contained in an image plane PI in all. On the other hand, 
this image plane PI is in agreement with the light-receiving field of CCD cameras 19a 
and 19b with which size is set to Breadth w and height h. And if the point M of a 
space-coordinates system (X, Y, Z) is considered like drawin g 4 , as shown in drawin g 
5 , it will be connected in a straight line to the lens core C of a focal plane F through 
the point m of an image plane PI (u, v). 

[0065] Here, considering the central projection over Point m, corresponding to several 
1, the relation between Point M (X, Y, Z) and the projected point m (u, v) is expressed 
with a degree type like drawing 4 . 
[0066] 

[Equation 2] u = (f-X/Z) -Nw/wv = (f-Y/Z) -Nh/h, several 2 [ i.e., ], expresses the 

pixel location in the image plane PI of Point m (u, v). In several 2, u corresponds to a 

horizontal pixel location and v supports the vertical pixel location. 

[0067] With this operation gestalt, since the image picturized from the car under 

transit is processed, it is necessary to assume a motion of the body in an image plane 

PI . Therefore, it is necessary to ask for the optical flow in an image plane PI , i.e., 

movement vector V, (u, v). When brightness I of the same point of three-dimension 

space is kept constant, the following differential equation between space-time is 

realized. 

[0068] 

[Equation 3] 

dl/dt = Ix-u+Iy-v+It = It corrects zero and a partial differential with horizontal Ix and 
Iy are [ a vertical partial differential and It of the partial differential of time amount 
shaft orientations, and u and v ] the components of horizontal [ of above-mentioned 
movement vector V ], and a perpendicular direction in an image plane PI , 
respectively. 

[0069] Next, how to ask for movement vector V using drawing 6 and drawing 7 is 
explained. As shown in drawin g 6 , reference block R is defined in the image plane PI 
in time of day t. With the upper left pixel pr as the starting point, this reference block 
R is the rectangle field of the range of n pixels, and contains the pixel of a mxn 
individual in u shaft in all at m pixels and v shaft. And an image plane PI is divided 
into two or more reference block R, and each reference block R of every is asked for 
movement vector V. The example of drawing 6 shows reference block R used as m= 8 
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and n= 8. 

[0070] Drawing 7 is drawing explaining how to ask for movement vector V to 
predetermined reference block R in an image plane P 1 . Drawing 7 corresponds to the 
image plane PI in time-of-day t+delta t in which deltat has passed since the time of 
day t of drawing 6 . And based on the vehicle speed data from the sensor section 14 
etc., the predetermined field in an image plane PI is beforehand appointed as search 
range S. The search range S is a rectangle field where it becomes M pixels on u shaft, 
and it becomes v shaft with N pixel, and M and N usually become sufficiently large 
compared with m and n. 

[0071] And comparison Brock C of reference block R and the same size is defined as 
a position to the search range S. Since size is sufficiently large compared with 
reference block R, it is necessary, as for the search range S, to move comparison 
Brock's C location little by little in the search range S. By drawing 7 , comparison 
Brock C is the size of mxn like reference block R, and shows the pixel pc at the upper 
left of comparison Brock C corresponding to the pixel pr at the upper left of a 
reference block. The pixel at the upper left of the search range S is set as comparison 
Brock's C pixel pc at first, after that, in the search range S, it moves 1 pixel of 
locations of Pixel pc at a time to u shaft orientations or v shaft orientations, and the 
below-mentioned operation is performed about all comparison Brock C that can give a 
definition in the search range S. 

[0072] Subsequently, a correlation value is calculated among comparison Brock C in 
reference block R in the time of day t of drawing 6 , and time-of-day t+delta t of 
drawin g 7 . Here, in the image data which is the set of a pixel, since the concentration 
value is made to correspond to all the pixels of a mxn individual, it asks for the 
difference of the concentration value for every pixel to which reference block R and 
comparison Brock C correspond. A correlation value is calculable if the sum about the 
pixel of a mxn individual is taken to the difference for every pixel of this 
concentration value. 

[0073] And to reference block R, the correlation value between all comparison Brock 
C in the search range S is calculated, and it looks for comparison Brock C who gives 
the minimum correlation value. For example, suppose that comparison Brock C who 
shows drawing 7 gives the minimum correlation value. 

[0074] In this case, as shown in drawing 7 , in an image plane P 1 , the vector which 
turns on comparison Brock C in time-of-day t+delta t from reference block R in the 
time of day t shown by the dotted line can be determined as movement vector V. 
[0075] Although drawin g 7 showed only one movement vector V, it asks for 
movement vector V in fact about all reference block R which can be defined as an 
image plane PI . This searches for spatial distribution of movement vector V. And the 
below-mentioned processing is performed based on spatial distribution of this 
movement vector V. 

[0076] Next, the above-mentioned distance DR and DL and the calculation approach 
of the width of road are explained using drawing 8 . Drawing 8 is drawing showing an 
example of distribution of movement vector V in the image picturized from CCD 
camera 19a. In drawin g 8 , since it is easy, in the longitudinal direction of a car, the 
case where the path road surface and the wall surface have touched in the boundary 
section 30 is assumed like drawing 3 (b). Moreover, distribution of movement vector 
V on Rhine LI in time of day t is considered. 
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[0077] As shown in drawing 8 , in the image picturized in CCD camera 1 9a, the 
magnitude of movement vector V is changing with the rate of change of abbreviation 
regularity by the path road surface in the lower part of the boundary section 30 to the 
magnitude of movement vector V serving as constant value on the wall surface in the 
upper part of the boundary section 30. Thus, the magnitude of movement vector V 
serves as a value depending on the distance z to a photography object. 
[0078] That is, supposing it performs the image pick-up by CCD camera 19a by frame 
period T in the car it is running at a rate vO (m/second), the migration length d of a 1 
inter-frame car is [0079]. 
[Equation 4] d = vOandT (m) 

It can express. Here, if a photography object considers the situation which does not 
change only in the direction of u in a motion, the direction of v, and the direction of z 
relatively [ car ], the following formulas will be realized that what is necessary is 
several 2 just to substitute above-mentioned x=d. 
[0080] 

[Equation 5] u = (f-d/z) -Nw/w = (f-vO.T/z) It can express -Nw/w. Movement vector V 
(u, 0) becomes settled by u shown in several 5, and this u is in agreement with the 
magnitude of movement vector V. Thus, the magnitude of movement vector V is in 
inverse proportion to the distance z with a photography object. 

[0081] Drawin g 9 is drawing in which the magnitude of movement vector V of Rhine 
LI shows signs that it changes corresponding to several 5. In drawin g 9 , while a 
continuous line shows the magnitude of the movement vector of a photography object 
to v shaft in the image of drawing 8 , the dotted line shows distance z. Since distance z 
becomes fixed, on a wall surface, it becomes fixed [ the magnitude of movement 
vector V ], so that drawing 8 may show. On the other hand, since it becomes small at a 
rate of abbreviation regularity so that distance z goes by the path road surface caudad, 
several 5 u becomes large linearly. 

[0082] Therefore, in drawing 9 , movement vector V cannot change with the rate of 
change of abbreviation regularity, but can distinguish a wall surface and a path road 
surface based on whether it becomes in general fixed, and can also judge the location 
of the boundary section 30. And MV (pixel), then the distance DL to the above- 
mentioned wall surface are based on several 5 in the average of movement vector V of 
a wall surface, and it is [0083], 
[Equation 6] 

DL = (f-vO.T/MV) -Nw/w can be computed and calculated. 
[0084] In addition, although movement vector V becomes small with the rate of 
change of abbreviation regularity as it goes above an image by the path road surface 
when a slot exists in a road edge, on the boundary of a path road surface and a slot, it 
changes uniformly [ rate of change ] and rapidly partially. Therefore, a slot can be 
detected by distinguishing this break point, and the distance DL to a road edge can be 
found based on the magnitude of movement vector V before and behind that. 
[0085] Moreover, what is necessary is to generate two or more fields where movement 
vector V becomes in general fixed, when becoming a partial wall surface like the 
guard rail instead of a single wall surface, but just to use the distance DL which finds 
the distance DL about two or more fields, among those serves as the shortest, while 
detecting a break point as mentioned above. Also when a guard rail adjoins a road 
edge, the distance DL of a road edge can be found based on the distance to the field 
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corresponding to a guard rail. 

[0086] In addition, as an example of each numeric value in several 5, it becomes focal 
distance f= 4 (mm), horizontal pixel number Nw=320 (pixel), and breadth [ of a light- 
receiving field ] w=4(mm) frame period T=l / 30 (second) extent. . 
[0087] If the above image processing is similarly performed to the image by two CCD 
cameras 19a and 19b, the distance DL and DR to the road edge in right and left of a 
car will be found. Therefore, while adding these, in consideration of the breadth of a 
car, the width of road in the road under transit is further computable. For example, 
when a car has Breadth W in the installation condition of drawin g 2 (b), the width of 
road RW is [0088]. 

[Equation 7] RW ** It can ask in approximation with DL+DR+W. 
[0089] In addition, if the width-of-road data corresponding to the computed width of 
road RW are related with map data and memorized possible [ updating ] in the width- 
of-road data storage section 13, it can use for various kinds of below-mentioned 
processings. 

[0090] Next, the concrete image processing in the navigation equipment concerning 
this operation gestalt is explained with reference to drawing 10 and drawing 1 1 . 
Drawing 10 is a flow chart which shows processing for the car under transit to prevent 
approaching a road edge, and drawing 1 1 is a flow chart which shows processing for 
the car under transit the road of two or more lanes to make it run a proper lane to a 
setting path. In addition, drawing 10 and drawing 1 1 are processings mainly 
performed according to control of a control section 11. 

[0091] If the processing shown in drawing 10 is started, the distance DL and DR to the 
road edge of both sides will be found, and the width of road RW will be computed by 
processing of the above image-processing sections 18 according to several 7 based on 
this (step SI). And the width-of-road data corresponding to the width of road RW 
computed at step S 1 are related with map data, and are written in the width-of-road 
data storage section 13 (step S2). At this time, it may be made to write in width-of- 
road data in the predetermined point path on the street set up beforehand. 
[0092] Subsequently, based on the distance DL and DR acquired in step S 1 , it is 
judged whether the car under transit visits a road edge too much (step S3), namely, 
what is necessary is to set up a predetermined distance used as criteria, and just to 
judge that a car visits a road edge too much and comes out to it, when distance DL or 
DR serves as a small value from this predetermined distance 
[0093] When the decision result of step S3 is "YES", a car visits a road edge too 
much, and comes out to it, and it warns a driver of a certain thing (step S4). For 
example, what is necessary is just to output as voice the predetermined message which 
visits a road edge too much, comes out to it, and shows a certain purport from a 
loudspeaker 17. Or the same message or a display notation may be displayed on a 
display 16. 

[0094] After finishing step S4 when the decision result of step S3 is "NO" or, it judges 
whether a car is running or not (step S5). When a car is not running (step S5; NO), 
since it is not necessary to perform an image processing, processing is finished. On the 
other hand, when a car is still running (step S5; YES), processing of step SI - step S5 
is repeated. 

[0095] In navigation equipment, real time can be asked for the always exact width of 
road RW by processing the above step SI - step S5. And since it was made to warn a 
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driver when the distance DL and DR to a road edge was supervised and the car under 
transit visited a road edge too much, operation of a driver can be assisted and the 
insurance under transit can be secured. Moreover, since width-of-road data were 
suitably written in the width-of-road data storage section 13, when running the behind 
same road, it becomes possible to utilize width-of-road data effectively. 
[0096] Next, the desired destination is set as navigation equipment and processing 
shown in drawing 11 is performed under the situation that a path is judged. First, like 
step SI, the distance DL and DR to the road edge of both sides is found, and the width 
of road RW is computed further (step SI 1). 

[0097] And the lane information over the lane under transit included in the map data 
of the map data storage section 12 is read (step SI 2). Since the road under transit is 
the information which shows **** with what lane, this lane information judges 
whether the roads under transit are two or more lanes based on lane information (step 

513) . 

[0098] When the decision result of step SI 3 is "YES", based on the decision result of 
step S 1 1 , it judges which lane is under transit among two or more lanes now (step 

514) . This judgment can be performed based on a ratio with the distance DL and DR 
to the road edge of the both sides of the car for which it asked at step S 1 . 

[0099] Then, the lane judged at step S 14 judges whether it is a proper lane 
corresponding to the path which arrives at the destination (step SI 5). That is, if the 
case where it is running the road of three lanes, for example is taken for an example, 
you may be which lane when a right-hand side lane becomes proper when turning to 
the right ahead generally, a left-hand side lane serves as fitness when turning left 
ahead, and going straight on as it is. Or the information on the proper lane at the time 
of left turn and right-turn may be set up beforehand. 

[0100] As a result of the judgment of step S15, when the car is running the proper 
lane, processing (step SI 5; YES) is finished. On the other hand, when the car is 
running the lane which is not proper, guidance of lane modification is directed to (step 
SI 5; NO) and a driver (step SI 6). for example, the case where it is running the left- 
hand side lane before the right-turn point — already — what is necessary is to output as 
voice the message of a purport which urges moving to 2 lane right to a driver from a 
loudspeaker 17, or just to display it on a display 16 

[0101] In navigation equipment, the lane in which a car is located by the road of two 
or more lanes can be judged on real time by processing the above step SI 1 - step SI 6. 
And unnecessary guidance does not need to be performed, when guidance is 
performed only when required and it has already run the proper lane, since it was 
made to guide lane modification to a driver only when it was not located in a proper 
lane, in order to perform right-turn, left turn, etc. Therefore, convenience is high and 
much more comfortable navigation becomes realizable for a driver. 
[0102] In addition, in the example of drawing 1 1 , only while the car is running the 
lane which is not proper, when directing guidance of lane modification, namely, while 
running the proper lane, the case where guidance of lane modification was not directed 
was explained, but it is not restricted to this, but while [ when a car is proper ] 
running, it may be made to perform a certain guidance. For example, while running a 
proper lane, guidance of "please maintain the lane of this as" may be outputted with 
voice etc. Thereby, the driver under operation can be made to be able to grasp running 
the proper lane, and sense of security can be given to it. 
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[0103] As mentioned above, although this invention was explained based on the 
operation gestalt, this invention is not limited to the above-mentioned operation gestalt 
at all, and it can guess it easily for amelioration deformation various by within the 
limits which does not deviate from the meaning of this invention to be possible. 
[0104] For example, you may make it display the image picturized with CCD cameras 
19a and 19b as an image pick-up means on a display 16. With this operation gestalt, 
since it is installed so that CCD cameras 19a and 19b may picturize the just beside 
direction in the car front, before a driver arrives at the location which can see the side 
directly, on a display 16, a side image is checked by looking and the thing of it can be 
carried out. Especially when a car advances into a crossing from a narrow alley, a side 
image can be checked by looking only by taking out a car tip to a crossing slightly, 
and it becomes useful at insurance transit of a car. 

[0105] Moreover, although the above-mentioned operation gestalt explained the case 
where it was installed so that CCD cameras 19a and 19b as an image pick-up means 
may picturize the just beside direction in the side of a car, it is not restricted to this, 
but you may install so that the direction of before [ slant ] approach in the side of a car 
may be picturized. Thereby, a side image can be preceded in time, and can be 
processed and the distance to a road edge can be found timely. 
[0106] Or you may install so that the direction [ in / for CCD cameras 19a and 19b / 
the side of a car ] of the bottom approach of slant may be picturized. Generally, if 
CCD cameras 1 9a and 1 9b with a vertical narrow field angle are used, when a car 
approaches a road edge, the case where a road edge stops entering in an image will 
arise, in such a case, since it comes out, and a road edge will enter in an image if the 
image pick-up direction of CCD cameras 19a and 19b comes together the bottom and 
there comes out and is even if it is, it becomes possible to find the distance to a road 
edge. 

[0107] Moreover, CCD cameras 19a and 19b which have a larger field angle may be 
used. For example, when a horizontal field angle performs above-mentioned 
processing separately to the left-hand side field and the right-hand side field in each 
image pick-up image using some CCD cameras 19a and 19b about 180 degrees, the 
distance to a road edge may be found. The distance to a road edge can be found 
thereby still more finely. 

[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the outline configuration of the navigation 
equipment concerning this operation gestalt. 

[Drawin g 2] It is drawing showing the configuration of the image-processing section 
of navigation equipment. 

[Drawing 3] It is drawing showing the installation condition to the car of a CCD 
camera, and the installation condition which looked at (a) from the car upper part, and 
(b) are drawings showing a right-hand side installation condition from the car front, 
respectively. 

[Drawing 4] It is drawing which expressed the image picturized by the CCD camera 
with the model of a pinhole camera. 

[Drawing 5] It is drawing showing the relation between a space -coordinates system 
and the pixel system of coordinates of image data. 

[Drawing 6] In case it asks for a movement vector, it is drawing explaining the 
reference block defined in an image plane. 

[Drawing 7] It is drawing explaining how to define comparison Brock as search within 
the limits, and to ask for a movement vector from the predetermined reference block 
in an image plane. 

[Drawing 8 ] In the image processing concerning this operation gestalt, it is drawing 
explaining the distance to a road edge, and the calculation approach of the width of 
road. 

[Drawin g 9] It is drawing explaining signs that the magnitude of the movement vector 
in an image and distance with a wall surface change. 

[Drawing 10 ] In the navigation equipment concerning this operation gestalt, it is the 

flow chart which shows the processing for preventing that the car under transit 

approaches a road edge corresponding to width-of-road detection. 

[Drawin g 1 1] In the navigation equipment concerning this operation gestalt, it is the 

flow chart which shows processing for a car while running the road of two or more 

lanes to make it run a proper lane to a setting path corresponding to width-of-road 

detection. 

[Description of Notations] 
11— Control section 

12 - Map data storage section 

13 — Width-of-road data storage section 

14 -- Sensor section 
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1 5 — Current position detecting element 

16 ~ Display 

1 7 — Loudspeaker 

1 8 — Image-processing section 
19a, 19b CCD camera 

2 1 ~ A/D converter 

22 — The 1 st image memory 

23 — The 2nd image memory 

24 — Movement vector detecting element 

25 ~ Movement vector processing section 



[Translation done.] 
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a^si eizsEM<7>i-^y-^3 ymmizn^x. 
[0040] ^muzxmz^ mstmi s cnea^ 

[0041] 

imiemmo&mi jar. *?tW(vi&mz:mm.<omm 

[00421^111 *msmmiz8k&j-n:-y-i>>B >■ 
mw&m&mfett-tmxih h . miitz^rr^y-i^ 
a wffli^i it. tm^-rm&Mi 2t. 

ms-r-fg&Ul 3 i:. 1 4 i: . S^EfiS^ 

£HUl5i:. v'^^.T-W 16i:. xe-A17t. H 
«^l»l 8fc. CCD^519a % 1 9bi:$T-£X 

[0043] fiUtfXHIAlcttl yc . $J$fS 1 1 li. -?-t- 

y-s^ a ^^M^f*aoiw^»j«-rs . mm® i i «c 
m^mmizvimm^mtii't^kMz^ r-ftxixj] 

. [0044] ttfi&r-^f&tlSB 1 2 Wm^-? 

ttr?Mzm!&m.<?)*z%:M : *:Vx-$> t ) . mmcD-R 

OM^DVD-ROMfrlU^ixS. tSE"r— ^EttSS 

[0045] ingx-^Eisgpi 3ii, *%^t^«»a 

°TIE(=IE^-r & ^ =E U -C» 4 . ±MO«ffl-r-^fB1§^ 
1 2cOJtJa7 ? -^^t,fSa : 3:5I«8'tt#J&^iiXi.* i \ 31 

m?-7Mzi&&i sizm&zti&mMT-fte&izmM 



[0046] *>*y-$ii 4*4. mmmt&&w$:mft*t 

fcttdS^S^ffitfr^^ GPS (Global Positioning 
System) «^&<?WHS£gfIi-5GP S^ffgKrh' 

[0047] ^IftffliBttffias 1511-t 1 4 

[0048]f^7H 1 6«2/nmci l^Jg^ 
iL*. itf)f-fXTW 1 6*4. MtttCRT, ffiAS 

[0 04 9] B««yig&18*4. 3£W£t£g$*L£2£ 
*»tmcft«Btiraa£fH#g^&6. ClC: 

[0050] mmm&iate^ a 

/D3^W2l'fc. *1MW^'J22J:, HS2® 
$L*=tV23t. mb^7 WMftffl»2 4fc. SBK* 

^CCD^7l9a s l 9b3&»fe^B««-9-SSB?I 
flB»Ofctf>^ — IjCOCCDX* 719 as6»fe<0 

[00 5 1] ^fcfcwe^ A/D3y^2 1ll 

«r-*t»JSU mmtZimco? V-MM®rr-? 

[ 0 0 5 2 ] Jg 1 mm* ^'J22 & If! 2Bffi-X^E»J 2 

^-Alif-^ £fg#rT£ . »lIft^U2 2li* 
«f^07U— AMf- ^SrtHftU »2B«W ; eU2 3 
lilo|fc07l/^Iffif-^^}g»tS, iox, ® 
&*!P1S1S1 8T'i4. »fc«Bf^2 7l/-A4hOB«7 f - 

[00 53] »Bi^h;Hfcaj»2 4Ji. flUBflL** 
y2 2atW2BflWqEy2 3W8ttSft.67U--AB 
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1 0 

[0 0 54] ©SK? WW8SS«2 5(4. 
9 M4ftiB»2 4fc:J: OfcasSfuteSi^ 

at»r-*»i: lthww-4. 
[0055] ^ar^ wuaaia2 4 fcswr^ 

10 

[0 0 56] 01£M^T. CCD^7l 9a, 19 

(:.CCD^7l9a, 1 9b^«W^S0RBttJB£- 

[0057] H3 (a) (4. «RJJ6r*feJlfcCCD* 
X919a. 19b^R»WBftiSr*mC**, H3 

(a) fc5*i"J:dfc. CCD^7l 9a, 1 9b<4* 

20 CCD^7l9a^SJfflC CCD^7l 

9b*«^t«fc^^ftffift(tfe3h.TV^. CCD# 

W-£>*U CCD^7l9b(t W^fflStfOfSJ-Srr&iV^ 
[0 0 58] H3 (b) (4. CCD^7l9a 

S3 (b> (c^-idtc. CCD 

30 W719 a-i$mffitem^xmneco&&$:Mmfr 

^Ti4. CCD*X5 19atJ:0aWIS*LfcB«fcai 
[0059] CCD^7l9all mB<OiS$ 

^i9bco^i4. 03 (b) km&&mm*mb& 
[0060] ^mmmte&zmi&wmwmz 

40 -owt. H4— H8*«!HbtBlBW"4. 

[0061] H4I4 N WJ£OCCD*>^l9a. 19 
bCi 0S«SixfcB«*tv*-;^>7W"r;PT* 
^L^H-Cft^, @4(Ci3V^Ti4. CCD^7l9a 
OgaSIH^fcafJJW-SBftTHPOfc. I^VXWfc« 

TV^o M^MFc0L^>-X^C^^>^--;Uc:St^ 

l. z.cou>x*&c**>uzQmmw(k (x, y. 

Z) — ^ IMPOtil SSSS 
(0, 0, -f ) £B«4M>ci:LT. 
50 (x, y ) 
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1 1 

[0 0 6 2] m%mm&cD£M (Xm, Ym, 

Zm) Zco&Mli. M£\fm3 (b) 

*U %*7mm%kcr>&m (xm, ym) fc|l#3*L6. 
-^k#. j£M (Xm, Ym, Zm) fc»»3*Ufc*ii 

( x m , y m ) onfti£te£T%£i'l.& • 

[0 0 6 3] 

[fSllxm = f ■ Xm/Zm 10 
ym = f - Ym/Zm 

*JcH5tt. H4fc»J6LT. 29GBttKK (X, Y, 
Z) fcISf-^<7)e;^Hg^ (u, v) Og|£&£ 

* ( x , y ) OxMl y«£**L«iRJKS-fr 

tui, vWh-T^CiktziD. t:?-fcA«flS (u f 
v) ^UfeOTfe-S. 04<7>ffiM£05<9ffigfc:m£ 

^. 20 
[0064] fir*5 we . tT^-fe^HflyR^Hfli™ 
Pill *Wl*IOB^NwfcSl*ft^Ha8ftNh 
O^RM«t^|SLT±3 0 . H«¥®P 1 fca±£S"CN 

il lMX#8MIw\ IJh^^CCD^^l 9 

fcffiHffi«S^j&M (X, Y, Z) @5C 
?jct"J: o C Hfil^MP 1 OjSm ( u , v ) SriloT^ 

■ [0065] iit, H4kH«fc. AraldltiW 30 

mmz^t&t. RiewjsL-c. (x, y, z> 

fcMITSftjfcj^ (u. v) <0B8flBiacStt«Sii6. 
[0066] 

[»2 ] u = ( f • X/Z ) - Nw/w 
v = ( f ■ Y/Z) • Nh/h 
"t^Srfc'fc* &2tl j&m ( u , v ) 0>BflPFBP 1 

[0067] ^+*>*PW»£SHI13 40 

*i3tB«*«H-r&W. S«¥WPlrttf>»*«o«iS 

S*/r 4 ^/l^ d— s ^fc^SBK^ h/PV ( u , 
v) Mi»4ies?*s$6. 3<>C7c25BK)H-jft<«BAS 

[0068] 
[*3] 

dl/'dt = Ix-u+Iy-v+It = 0 
fc*5U ^tL^ixB^MP lrtKlfe^T. I x#*T' 50 
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[0069] memmi zm^T&m^? 

Bflfl t <cisH-4B*¥WP 1 rtfc«Hru y ^ r 

2>D. :^T*mXnffiO®^£-£A/C^&. ^LT. B 
M^ffiP 1 ftWfc^WR^nr^Rfc^BL. #*<D# 

T'il m=8. n = 8fc&4#H^u^R£*l/CV* 

[0070] BflPFBHP 1 rt<Z)H^9#!H:/n 

+ Attci5(t^B« :s FMPl(c^-r J S # *LT. -fe^ 
IMS 1 4 3&» feiOWSlr — ^*fiai-^V . Hffi^MP 1 

JMStSot, SMH1 M. Ntf*m. nfc:Jt^£fc+ 
[007 1] -tLT.'lh-HCTSidWU «H/D7 

^ r fc jw-f xcojmr o y ^ c ^E^coffig^^-r 

& Lr^Ba^iBBtf & ^. i7tli it)R /□ -/ ^ C 

X a -/ 9 cr>&±<?Mm p r trMJE-T 5 JtSSXo -y^CO 
£±coM^ pcSSLTi^, S^lir^* — f-gffl S oic 
±0»iJWt/ny?CO«pct^feU *<V& 

^rig^T^jtKy o y ^ c fc-pv^aBtoatir* tf 

[0072]»:V^T> H6^.«rSiJtfc^tS#»a^Ov 
^Rh. H7m*Jt+AtKJ3*t41fc|Rrny^C<?D 

^&<0T\ #^7'n^^RhJt®^'n»y^CO»K'r^ 

[0073] ^*LT. #Sgro y ^ RCTL. ^-^ffi 

Will i7 tc^JtKX D y 9 C 36«a/J^*iB8fi*-¥- 
[0 0 74] ^^^-<1 07(^^3^ 



(8) 



1 3 

? Ripbmm t + A t te*5lt S tiM7n «/ 9 C £f«j#> o 
[ O 0 7 5 ] 07 1 -0<?>Wm^9 hJUVCDfr^k Lfc 

[0 0 7 6] S82rJBlvt. ±IE<9ESiDR. D 

LATmntoKattiwmtz. H8«. ccd^ 
(b) fcfRtatk:. m^com-jjfaiz&^x . m&mtmm 

[0077] .B8fc*-$\J:<3teU CCD^7l9aC 

[0078) t4i)^ ffivO (m/&) T^fTLT 

!&KJSdl4. 
[0079] 

[»4] d = vO - T (m) 

JL5£<7)^ 2 x = d SrftAtttfcf i < . 

[0080] 

[gfc5] u = (f-d/z) -Nw/w = (f 
• vO • T/z ) • Nw/w 

V (u. 0) tfgji). ^COu(^i&<^h^VO>t# 

[ 0 0 8 1 ] H9(4. v4 yL ItfflWK? h)\sV<7>± 
S3**. *5^JCLT^^*^t5SrrHT2b«. 

H9fc*3ivctt % H8<^B«+eovwz#u 
ins— «ww>&t4ns<*6ot. as^ufctefcttfc 
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[0083] 
IR6] 

D L = ( f • v 0 ■ T/MV ) - Nw/w 
10 **ffiLT*&*£fca*TS*. 

[0 0 84] 4*5. m&mm&trtP£Et&%&\±. m 
[0 085] *-^«BffTrfc«r<. «it«r-F 

we. «»SB<OffiJSIDL«r««)4^i:s&«r**. 

[0086] 4*5. a 5 (=t$it&«aui^>Aficn t lt 

14. m^^f -4 (mm) . *Wl*I^Ifl8:Nw= 
32 0 (tT^-fcAO . S3ISBftD4Mw=4 (mm) . 
71/- AfflfflT=l/3 0 (&> S0W:*r6 . 
30 [0087] JJUKOHflMSaSr. 2"90CCD^7l 
9a. 1 9 b fc J: LH«fcffr£tf . Htpi<0;£ 

-tot. iii^taniSfc««c. XK2*H4)flM£4-* 
L/C. ^*0»fc±5»t*ii3«t»aj-*-Sii:**r* 

*• «itr. 02 (b> ^s^«®tci3^Tm^e«g 

[0088] 

[»7]RW ^ DL-t-DR+W 
40 [0089] 4*5. lCffl$^^RW^JEb"r^iIifl 

[0090] «ft:. 3jcSBBEOTfcffs+t:y-^ 3 >^ 
50 ^o-ft-htftl), 4fc\ Bl OSI^Bl 114. 



(9) 

15 

^csyessB 1 1 <n$miz&.i Tm>tLZ>xmT$> & . 

[0091101 0lZ^T1&mmti3i*tlZ> t . -Li&O 
T5B|gRW*JSaj$itS Uf»/7S1 ) . *LT. ^ 

[0092] ifcWC. Xf?7S 1 fc:J3Vvc^&;ft.*:ffi 
SID L . D RIZM~3\, \X . im* O^MaStS&SgfcS 9 
»rri>&«>9&>#flK3*LS (Xf77S3) . 

^fc**B^^8BSi£&£LT33#. ilDL 

mffitfimmiz-g *y ^rx-fc & t «»rf*i.tt «t 
[0 0 9 3] ^-yrssiofflffisgma* tyesj -c£> 

— fc^^S (Xf77S4 ) . mux. Jli&JgCSO 
5a?-CJ>S l-S:^-r^Oj>t -y-fe-^'Sr . Xtr-* 17 20 

Lxtajj-ftusx^. h&^i. mm<v*>y 

[00 94] X-T^yTSS^JBrif&Sia 5 TNOj TfeS 

x-bhi)*£fr*mwrr& (x-r 7rs5) . mps#76ff 

+T=3:Vi^- (^f77S5 ; NO) . WS&m&Tio 

T-&£3#£- (Xf77S5 ; YES) s Xf77S 1~ 
XT--/TS5<Oi8ia^>)3l-r. 30 
[0095] -r-b-^-v- 3 ^SHtefc^T. feUKOXv^ 
77S i~-XT->-/7-s5<oJ3ia^5c:tC=J:0. ^= 

.It 4fc. iHax-^Sr 

•Sffli-Sdt^tgfc^rl.. 40 
[009 6 ] mz. Ml 1 fcij***HHi. >b>'-^ 3 

StTtT^fLS . ^f77SUi«iar, 

Uf77Sll) . 
[0097] LTk tftHx-^aitSf 1 2<0«6H-r- 

ffc&£ti&jm*nm&izictt&m&m& : £:mx-tii-? 

(^f77S12) . CO*|gffi««^ *ff+«SK»*« 

{°pmx$>&&7jkTrimx'bz,fi:#>. mmfifflizm-j* 
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77S 13). 

[0098] Xf77S 1 ScVpmm&i* fYESjt 

xf77s i icrmmmmzm-j^x. im. 
mm.<r> o ■hm&.t'nm&Zjmfxb a & 

(Xf77S14) . .KO^te.. Xf77SlHt$ 
m-J^XftoZkrfXZ & . 

[0099] m^X. Xf77S 1 4T¥IMZtlfiiW& 
"SirZWWftZ Uf77Sl5) . -T3:;fo^. Witt 

3^<?mm*%£fvx^z>n&*m<ztzt. —wm 

KJttS fc £ (teffll^^^Sttfc =5: 0 , & 

[0100] Xf77S 1 S^J^cO^^ imimiE 
^r3CSS-^firLT^-5»^»± (Xf77S 1 5 ; YE 
S) «ffi|Sr»i&. — ^r. ^S*9ffiE-Cti:5rV>^Sr^ 
=ffLTV^^tt (Xf77S15 ; NO) . H9-f A 
-t=*«^|g^l^Sr*g*^-6 (Xf77S 16) . fiflj 

*> a 2m^izmsm> ^ 1 1 k ^N'-tcffi-r 

[0101] tt^-^a ViSgfcfeJVvC. IJLhiOX-r 

77si i—^'/t-s i eemmzfto^tizi:*). 
ff?izMzmEZimi,z®mL%^m&(7>x-. y^a* 

*< . v* 5 4 j<-tzt -ox—m&M*-rt'-y-is 9 ^ 

[0102] ^rfc\ G9 1 lOMX'IZ. m&smEX'liik 

v v«GHL^3^f lt v fc * izcox-mmzmcomft 

ftZfrvXolzl.XhX^. Witt. aiE^r^tSISr^f 

TS&Mi**i Lit tfX'Z h . 
[0103] fiUt, HSg^MtcS-o'^^HjSriiBjL^: 

[0104] 05i.tt, mimtt LX<r>C CD^51 



(1( 

1 7 

9a. 1 9btJ; OML)tIWf a71/-f 16t 

*7l9a\ I 9 btf&mWjlZiS^TX&fift&jkm. 
-?&£5lzmMZivx^2>jzib. 

6t=.T:m%M&$:W2.-?z>ztTZz>. <mz, m^tm 
toio5]ifc. ismmmmx-n. sm^at lx io 

«OC C 519 a, 19 b**^coH3r{:3il1-£3& 

a»\ z\tnzmt>tvr^ mmcom^iz^hm^m^*)-^ 

[0 106]J,5^lt CCD*>7l9a, 19b£ 

SLT-fci^. — mz % mmjjfiiicowftim^ccDx 

^7l9a. 19b £JH<,v5 t . ^M^"aIS&^trjggL 20 

£<0J: dSr^T&oTk. CCD^7l 9a, 19 
b*)SHR2nfaPTO9-Cfc*Uf* M3&%timi2iftlzAZ 

X-c^mmZ&ib &Z\k jfpBTtgfc ^rS . 
[0 1 0 73 ^^, ZOfc^WMtt-thCCVtiji? 
1 9a. 1 9b&m^Xt>±\.\ Wx.tZ. sfc^PirfaiO® 
fiifil 8 0SiS<fc^CCD^^7l 9 a, 19b£ffl 

UlHSKJbM'^uiS:*? 3 .1 1 iz i. *) , m&lftt. 

x-<omm^ibxi>^\. ztitzx*) -m%*bmfr< 30 

C0108] 

Zft^xm&m±X-cvmm:'git>&J:ot l zLt:<7)X\ m 
[ 0 1 0 9 ] £ *«H*-*-t:y-s< g ^gfcjgffl 
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[0 1 ] *^te^litc«S^b*7-"— i/ 3 ^ScOfp&lf 

[02] -tty-iss ^m^mmm^m^Tfrt 
mx'hh. 

[S3 ] c c D#*7com$^mm^&7sitm?2> 
0. (a) \&m±%i>>i>3Ximmim. (b)ii^ 

[04] ccD^^^fciOSmSfutBa^ev*- 
[05] ^ISLSg^ k Iftf- ?<F>\l-7 -fc; Wl&g^p 

[06 ] %m^? hfot:?mzi&tzw®?mpitiz%mr? 

[07] J9r^D#{&:7'o -y ? fcif L „ if— 

tbziT&zmwt?>®x'i>?>. 
[08] i&zfflmtz&&m®$miz&^x . ^ssssa 

[0i o] $mmmtz&s>-t-\:y-isaygmtzt3^ 
X- mm^mi,zn^Lx . fefi'pcr>wmtfm&mz%3g 

•5. 

[01 1] ^^Sgjg^t^ST-t-y-^gV^afcris^ 

£ttc?7 a— h X'$> h . 
[«^-^BJ3] 
1 l-$!l#25 
1 2-itt0-7 r -^sea5 
1 

1 4--fe^a5 

1 5-3stEfifg^ajsf 

1 6— -r-f ^T'l^'f 

1 7-^.e-^ 

1 8-a»5KlS 

19a. 19b-CCDW5 

2 1-A/D3>'A-^ 

2 3— S2S^LX^y 

2 h/wsasp- 



(11) 
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(51)Int.C1.7 Kggef- FI 

G0 8G 1/04 GO 8 6 1/16 C 

1/16 G0 6F 15/70 4 1 0 

F ?—Ms (##) 2F029 AA02 AB01 AB07 AB09 AC02 

A004 AC09 AC14 AC18 
2F065 AA06 AA12 AA22 BB13 CC40 

FF04 FF09 FF63 FF64 FF67 

JJ03 JJ05 JJOS JJ26 PP01 

QQOO QQ03 QQ13 QQ24 QQ25 

QQ26 QQ27 QQ28 QQ41 SS03 

SS09 SS13 
2F112 AD05 AD10 BA18 CA05 FA03 

FA07 FA21 FA27 FA41 
5H180 AA01 BB13 CC04 FF04 FF05 

FF22 FF25 FF27 FF33 LL02 

LL07 LL08 
5L096 BA04 CA04 DA02 EA23 FA34 

FA54 FA66 GA08 GA28 HA04 



